-- Logs begin at Mon 2022-06-27 20:28:24 UTC, end at Mon 2022-06-27 21:35:24 UTC. -- Jun 27 21:07:37.975689 dv-cinder-847733-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 21:07:37.984385 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 21:07:37 2022] *** Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: nodename: dv-cinder-847733-1-iscsi Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: machine: x86_64 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: clock source: unix Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: pcre jit disabled Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: detected number of CPU cores: 4 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: current working directory: / Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: detected binary path: /usr/bin/uwsgi-core Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: your processes number limit is 47680 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: your memory page size is 4096 bytes Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: detected max file descriptor number: 2048 Jun 27 21:07:37.986996 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: lock engine: pthread robust mutexes Jun 27 21:07:37.987858 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: thunder lock: enabled Jun 27 21:07:37.987858 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 21:07:37.987858 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 21:07:38.032962 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: Python main interpreter initialized at 0x557dbc5049c0 Jun 27 21:07:38.032962 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: python threads support enabled Jun 27 21:07:38.032962 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: your server socket listen backlog is limited to 100 connections Jun 27 21:07:38.032962 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: your mercy for graceful operations on workers is 90 seconds Jun 27 21:07:38.033336 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 21:07:38.033336 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: *** Operational MODE: preforking *** Jun 27 21:07:38.033636 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: *** uWSGI is running in multiple interpreter mode *** Jun 27 21:07:38.033636 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: spawned uWSGI master process (pid: 103359) Jun 27 21:07:38.033841 dv-cinder-847733-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 21:07:38.035076 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 1 (pid: 103360, cores: 1) Jun 27 21:07:38.035076 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: spawned uWSGI worker 2 (pid: 103361, cores: 1) Jun 27 21:07:38.035076 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 21:07:38.685517 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:07:38.686156 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:07:39.794230 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:39.794230 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 27 21:07:39.794844 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:39.794844 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: from cryptography.utils import int_from_bytes Jun 27 21:07:39.796198 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:39.796198 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 27 21:07:39.796646 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:07:39.796646 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: from cryptography.utils import int_from_bytes Jun 27 21:07:42.236461 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:07:42.237051 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:07:42.237139 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:07:42.237139 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:07:42.237516 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:07:42.237591 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:07:42.237667 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:07:42.237809 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:07:42.237956 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:07:42.238130 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:07:42.238225 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.238477 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.238625 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.238770 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.238867 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239097 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239245 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239395 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239493 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239739 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.239870 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240023 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240126 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240331 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240432 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240673 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240803 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.240927 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241084 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241298 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241442 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241606 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241738 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-1-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.241922 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242069 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-1-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242198 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242294 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242593 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242731 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242835 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.242929 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243124 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243267 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243427 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243558 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243774 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.243908 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.244058 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.244286 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.244559 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.245800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.245966 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246086 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246230 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246355 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246498 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246634 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246785 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.246934 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247054 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247170 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247325 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247480 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247637 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247758 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.247874 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248034 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248187 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248404 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248596 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248737 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-1-iscsi {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.248881 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-1-iscsi {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249001 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249147 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249263 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249417 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249574 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249697 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249839 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.249974 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.250225 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.250413 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.250653 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.250821 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.250949 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251084 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251242 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251375 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251649 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251787 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.251959 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252098 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252224 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252348 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252483 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252623 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252757 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.252896 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253027 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253161 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253309 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253442 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253570 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253695 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253819 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.253951 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254076 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254211 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254348 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254473 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254602 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254725 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254840 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.254955 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255063 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255186 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255310 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255434 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255571 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255731 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.255892 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256045 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256178 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256313 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256439 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256571 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256698 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256823 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.256953 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257090 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257225 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257359 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257511 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257637 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257772 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.257899 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258024 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258149 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258280 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258404 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258538 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258669 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258795 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.258921 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259061 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259193 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259336 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259474 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259600 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259772 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.259897 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260021 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260419 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260627 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260848 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.260993 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261119 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261257 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261384 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261526 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261652 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261787 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.261923 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262049 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262182 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262307 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262431 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262563 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262735 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.262870 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263030 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263162 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263357 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263545 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263728 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.263873 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264009 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264134 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264274 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264400 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264535 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264669 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264798 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.264922 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265056 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265191 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265366 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265503 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265658 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265788 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.265984 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266191 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266337 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266473 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266599 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266724 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266856 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.266992 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267120 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267254 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267381 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267505 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267693 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267838 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.267974 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268099 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268233 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268359 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268557 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268750 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.268889 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269019 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269155 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269284 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269420 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269545 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269679 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.269812 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270012 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270202 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270357 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270488 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270614 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270754 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.270994 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271136 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271262 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271397 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271522 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271669 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271811 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.271937 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272071 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272273 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272407 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272532 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272656 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272780 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.272952 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273095 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273257 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273391 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273553 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273698 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.273868 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274010 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274137 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274267 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274481 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274663 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.274884 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275014 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275152 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275278 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275403 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275527 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.275697 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276188 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276326 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276451 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276575 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276710 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276835 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.276961 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277086 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277210 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277409 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277609 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277749 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.277877 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278010 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278144 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278269 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278403 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278562 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278695 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.278890 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279070 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279206 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279348 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279477 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279646 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:07:42.279794 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.279920 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280133 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280314 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280450 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280589 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280716 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.280851 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281091 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281229 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281355 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281479 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281658 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281785 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.281967 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282104 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282275 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282401 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282594 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282729 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.282899 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283026 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283205 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283339 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283510 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283680 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283850 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.283972 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284168 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284315 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284491 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284631 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284802 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.284930 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285112 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285239 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285423 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285568 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285727 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.285866 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286041 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286168 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286359 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286494 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286672 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.286976 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.287103 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.287306 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.287450 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.287664 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.287806 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.288011 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.288215 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.288519 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.288713 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.288896 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289072 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289248 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289420 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289559 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289684 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289809 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.289933 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290083 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290273 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290410 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290535 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290666 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290791 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.290915 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291039 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291186 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291399 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291528 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291682 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291809 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.291943 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292069 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292200 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292326 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292449 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292598 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292745 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.292879 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293012 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293137 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293261 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293395 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293528 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293653 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293784 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.293909 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294033 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294206 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294344 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294513 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294640 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294815 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.294942 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295115 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295259 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295417 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295546 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295741 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.295881 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296018 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296148 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296337 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296457 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296652 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296788 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.296994 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297129 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297261 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297397 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297548 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297677 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297851 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.297978 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298154 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298279 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298458 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298584 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298757 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.298883 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299063 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299188 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299365 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299499 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299689 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.299819 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300009 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300137 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300315 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300465 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300615 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300749 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.300933 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301060 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301231 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301393 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301587 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301713 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301839 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.301961 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302117 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302255 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302424 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302552 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302730 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.302860 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303038 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303166 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303351 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303508 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303747 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.303935 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.304077 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.304384 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.304518 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.304716 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305025 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305153 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305349 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305593 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305720 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.305979 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.306153 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.306280 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.306578 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.306728 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.306885 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.307188 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.307315 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.307490 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.307824 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.307952 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.308130 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.308423 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.308559 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.308729 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.308987 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.309116 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.309312 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.309440 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.309627 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.309764 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311027 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311178 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311308 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311433 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311573 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311829 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.311969 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.312097 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.312236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.312364 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.312502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.312502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313248 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313385 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313385 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313622 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313756 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.313881 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314005 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314128 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314252 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314385 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314519 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314653 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314784 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.314909 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.316520 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.316520 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.316771 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.316771 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317009 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317009 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317251 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317390 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317517 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317646 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317779 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.317904 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318035 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318168 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318293 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318425 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318552 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318676 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318799 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318932 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.318932 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.319194 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.319318 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.319318 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.319552 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.319707 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322064 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322205 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322205 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322441 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322565 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322565 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322812 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322935 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.322935 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323168 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323300 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323433 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323558 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323701 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323828 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.323964 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324103 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324236 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324367 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324490 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324614 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324746 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.324886 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325011 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325134 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325257 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325379 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325504 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325640 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325765 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.325890 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326013 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326136 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326276 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326408 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326534 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326658 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326778 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.326901 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327034 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327159 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327290 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327414 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327537 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327681 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327820 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.327945 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328069 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328191 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328314 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328437 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328569 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328694 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328826 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.328950 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329076 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329275 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329526 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329649 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329779 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.329903 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330036 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330170 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330309 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330434 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330566 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330688 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330825 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.330963 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331096 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331222 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331346 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331468 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331620 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331747 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331870 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.331994 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332199 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332327 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332466 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332592 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332724 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332858 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.332982 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333115 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333241 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333365 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333497 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333625 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333749 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.333882 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334006 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334136 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334260 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334385 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334498 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334657 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334808 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.334931 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335055 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335178 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335301 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335492 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335648 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335774 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.335909 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336034 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336166 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336291 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336416 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336539 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336670 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336801 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.336924 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337048 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337172 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337295 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337419 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337557 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337690 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337815 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.337939 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338062 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338184 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338307 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338439 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338565 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338689 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338820 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.338944 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339075 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339206 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339339 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339464 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339588 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339588 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.339974 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340099 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340230 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340356 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340480 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340612 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340745 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340870 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.340993 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341117 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341239 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341371 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341504 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341630 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341795 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.341922 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342141 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342361 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342641 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342767 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.342890 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343022 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343147 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343325 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343453 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343653 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343789 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.343965 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.344096 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.344273 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.344529 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.344650 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.344859 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345000 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345255 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345397 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345523 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345647 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345771 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.345895 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346028 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346166 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346335 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346477 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346640 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346769 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.346955 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347092 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347260 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347397 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347583 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347787 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.347917 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348040 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348188 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348314 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348486 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348615 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348788 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.348925 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349089 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349216 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349418 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349546 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349674 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349807 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.349970 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350099 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350295 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350434 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350604 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350812 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.350941 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351075 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351200 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351324 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351488 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351653 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351825 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.351953 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352127 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352255 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352464 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352601 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352727 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.352859 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353025 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353154 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353325 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353454 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353626 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353755 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.353961 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354089 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354271 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354575 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354704 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.354886 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355013 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355190 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355396 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355523 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355681 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355808 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.355941 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356112 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356240 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356414 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356542 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356710 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.356845 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357010 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357129 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357310 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357444 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357611 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357745 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.357907 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358034 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358213 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358347 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358513 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358647 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358812 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.358937 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359111 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359236 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359532 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359733 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.359862 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360033 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360161 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360343 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360479 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360649 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360775 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.360947 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361074 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361245 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361373 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361551 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361677 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361850 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.361974 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362148 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362285 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362452 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362578 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362747 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.362881 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363059 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363185 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363357 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363491 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363678 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363820 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.363980 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364107 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364281 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364580 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364721 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.364878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365012 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365178 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365304 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365643 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365780 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.365959 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366112 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366240 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366419 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366548 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366715 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.366843 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367016 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367152 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367319 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367448 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367639 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367795 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.367948 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368075 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368248 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368375 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368552 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368679 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368853 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.368983 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369154 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369283 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369457 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369585 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369759 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.369895 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370056 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370192 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370357 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370485 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370659 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370799 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.370958 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371087 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371257 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371393 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371574 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371734 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.371907 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372033 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372204 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372336 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372503 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372638 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372797 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.372921 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373116 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373242 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373419 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373544 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373737 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.373861 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374058 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374184 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374372 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374499 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374670 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374795 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.374979 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375106 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375284 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375417 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375658 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375786 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.375912 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376036 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376197 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376327 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376503 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376638 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376807 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.376941 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377107 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377234 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377534 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377712 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.377847 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378015 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378143 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378318 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378445 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378627 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378831 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.378957 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379081 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379235 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379364 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379531 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379720 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379847 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.379979 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380155 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380281 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380457 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380583 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380760 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.380885 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381059 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381193 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381362 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381509 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381695 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.381822 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382003 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382130 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382311 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382439 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382618 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382753 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.382920 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383047 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383246 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383381 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383516 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383673 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383824 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.383952 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384144 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384324 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384459 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384641 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384776 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.384951 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385072 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385261 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385389 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385570 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385776 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.385913 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386040 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386173 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386301 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386473 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386609 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386779 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.386916 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387083 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387219 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387386 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387528 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387731 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.387860 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388036 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388165 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388378 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388539 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388665 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.388788 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389039 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389168 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389346 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389482 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389654 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389781 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.389958 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390087 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390259 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390395 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390558 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390693 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390863 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.390992 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391180 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391309 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391480 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391670 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391811 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.391937 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392091 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392220 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392407 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392535 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392717 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.392879 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393017 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393143 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393385 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393511 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393690 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393818 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.393970 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394105 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394315 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394442 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394627 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394755 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.394948 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395264 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395391 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395584 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395761 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.395953 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396089 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396217 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396342 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396504 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396633 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396814 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.396950 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397156 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397288 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397522 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397648 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397827 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.397965 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398132 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398261 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398428 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398557 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398743 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.398878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399054 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399189 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399486 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399694 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.399823 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400000 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400130 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400303 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400440 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400627 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.400756 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.401287 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.401417 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.401609 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.401738 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.401924 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402060 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402223 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402350 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402532 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402660 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402835 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.402964 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403136 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403265 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403442 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403580 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403771 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.403897 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404073 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404200 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404377 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404516 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404679 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404840 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.404968 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405093 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405267 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405404 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405584 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405713 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.405887 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406100 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406229 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406363 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406491 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406617 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406799 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.406935 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407244 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407416 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407553 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407757 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.407886 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408064 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408193 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408365 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408512 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408664 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408796 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.408965 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409092 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409270 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409581 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409709 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.409886 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410015 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410187 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410315 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410492 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410635 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410797 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.410925 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411119 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411245 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411419 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411559 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411765 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.411902 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412076 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412210 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412383 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412521 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412679 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.412836 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413006 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413145 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413309 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413437 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413611 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413739 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.413911 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414040 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414217 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414354 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414521 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414649 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414820 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.414947 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415122 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415256 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415423 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415550 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415767 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.415908 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416143 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416280 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416405 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416543 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416676 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416801 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.416970 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417101 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417273 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417413 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417574 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417747 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.417969 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418098 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418225 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418349 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418501 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418637 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418815 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.418941 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.419132 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.419356 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.419498 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.419684 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.419815 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420000 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420129 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420312 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420441 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420623 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420753 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.420934 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421063 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421250 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421388 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421562 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421693 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421871 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.421997 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422177 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422312 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422480 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422606 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422792 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.422919 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423103 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423239 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423413 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423549 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423767 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.423949 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424087 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424279 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424415 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424588 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424716 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.424903 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425107 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425235 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425360 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425503 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425632 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425814 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.425951 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426120 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426333 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426461 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426595 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426731 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.426856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427007 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427144 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427334 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427462 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427673 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427811 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.427998 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428127 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428303 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428479 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428667 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428797 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.428979 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429107 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429291 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429433 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429596 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429724 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.429940 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430075 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430245 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430381 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430547 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430676 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430854 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.430982 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.431164 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.431291 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.431471 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.431709 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.431840 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432030 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432237 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432364 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432489 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432675 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432803 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.432979 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433116 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433283 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433411 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433590 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433719 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.433897 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434040 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434207 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434333 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434511 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434641 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434823 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.434954 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435124 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435251 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435424 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435543 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435755 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.435883 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436066 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436266 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436470 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436606 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436740 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.436889 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437018 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437209 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437480 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437622 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437826 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.437953 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438136 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438264 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438457 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438592 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438759 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.438887 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439059 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439188 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439364 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439502 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439693 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439822 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.439998 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440135 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440300 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440436 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440605 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.440907 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441034 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441205 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441343 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441508 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441634 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.441815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442034 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442171 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442382 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442510 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442698 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442826 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.442995 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443131 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443321 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443450 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443650 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443780 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.443960 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444147 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444315 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444445 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444627 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444755 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.444933 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445063 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445237 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445365 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445540 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445659 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445839 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.445976 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446136 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446263 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446447 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446652 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446790 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.446914 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447038 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447163 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447311 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447439 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447653 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447795 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.447938 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448063 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448244 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448380 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448547 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448677 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448848 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.448976 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449155 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449290 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449454 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449588 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449754 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.449882 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450054 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450193 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450386 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450516 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450642 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450769 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.450931 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451068 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451236 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451364 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451538 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451832 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.451975 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452157 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452284 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452463 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452591 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452792 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.452928 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453114 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453241 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453415 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453543 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453716 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.453858 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454021 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454150 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454321 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454447 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454639 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454780 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.454944 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455071 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455249 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455376 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455562 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455731 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.455893 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456023 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456203 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456418 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456560 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456764 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.456891 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457047 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457175 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457375 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457517 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457680 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457815 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.457987 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458108 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458283 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458410 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458583 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458711 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.458902 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459211 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459339 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459517 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459683 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.459885 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460013 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460190 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460317 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460496 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460624 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.460934 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461136 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461266 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461390 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461513 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461675 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461820 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.461977 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462111 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462280 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462408 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462585 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462721 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.462887 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463014 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463193 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463323 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463532 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463721 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.463876 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464012 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464197 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464326 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464509 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464638 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464823 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.464951 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465129 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465257 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465435 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465564 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465740 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.465859 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466040 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466167 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466351 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466489 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466675 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.466881 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467008 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467141 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467266 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467389 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467581 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467760 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.467889 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468075 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468196 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468394 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468524 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468718 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.468845 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469024 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469152 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469339 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469466 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469657 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469794 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.469960 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470094 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470262 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470390 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470565 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470705 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.470983 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471156 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471284 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471457 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471594 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471775 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.471900 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472072 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472199 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472374 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472515 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472676 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472805 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.472976 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473104 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473282 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473421 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473585 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473714 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.473884 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474010 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474184 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474311 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474479 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474606 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474777 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.474905 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475079 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475208 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475460 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475588 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475790 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.475919 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476096 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476224 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476394 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476521 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476694 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.476829 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477033 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477169 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477296 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477420 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477547 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477680 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477842 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.477979 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478143 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478272 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478443 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478584 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478744 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.478872 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479044 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479172 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479342 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479479 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479662 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479793 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.479990 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480120 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480296 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480423 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480611 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480737 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.480927 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481055 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481230 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481357 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481540 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481673 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481846 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.481973 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482160 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482295 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482472 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482598 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482778 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.482914 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483081 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483209 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483401 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483530 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483732 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.483871 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484045 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484179 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484350 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484477 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484650 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484785 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.484956 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485084 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485262 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485398 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485584 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485712 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.485902 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486029 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486201 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486329 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486521 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486643 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486834 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.486962 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487291 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487434 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487561 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487763 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.487891 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488089 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488230 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488398 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488525 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488702 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.488830 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.489014 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.489221 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.489356 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:07:42.489483 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.489607 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.489906 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.490218 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.490540 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.490876 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.491187 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.491509 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.491854 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.492198 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.492506 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.492898 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.493160 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.493472 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.493786 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.494089 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:07:42.494330 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103360) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:07:42.550797 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Registered counter for database nova_api Jun 27 21:07:42.555517 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Registered counter for database nova_api Jun 27 21:07:42.668624 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.670884 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.676241 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.677187 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.731812 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.context [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0f07735-a13a-4bd4-a3de-46acb69e68ee(cell1) {{(pid=103360) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:07:42.732005 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.context [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0f07735-a13a-4bd4-a3de-46acb69e68ee(cell1) {{(pid=103361) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:07:42.735740 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:42.735898 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:42.737340 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:42.737476 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:42.738129 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:42.738266 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:07:42.740238 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:42.740374 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_concurrency.lockutils [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103361) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:07:42.742259 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Registered counter for database nova_cell0 Jun 27 21:07:42.742392 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Registered counter for database nova_cell0 Jun 27 21:07:42.746130 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Registered counter for database nova_cell1 Jun 27 21:07:42.746274 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Registered counter for database nova_cell1 Jun 27 21:07:42.755138 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.757055 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.758918 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.762384 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.763083 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.765309 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.766593 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.903126 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.911713 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO dbcounter [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Registered counter for database nova_cell0 Jun 27 21:07:42.912282 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO dbcounter [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Registered counter for database nova_cell0 Jun 27 21:07:42.922289 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_db.sqlalchemy.engines [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103360) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.925920 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG oslo_db.sqlalchemy.engines [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:07:42.926886 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writer thread running {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:42.931466 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writer thread running {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:07:43.258814 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:43.259647 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:43.266171 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:43.267013 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:43.606580 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:43.612611 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: WARNING keystonemiddleware.auth_token [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:43.617711 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:07:43.617974 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557dbc5049c0 pid: 103360 (default app) Jun 27 21:07:43.620076 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:07:43.621264 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] 10.222.0.27 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001774 Jun 27 21:07:43.621985 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 1/1] 10.222.0.27 () {50 vars in 788 bytes} [Mon Jun 27 21:07:43 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:07:43.623896 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: WARNING keystonemiddleware.auth_token [None req-330eb166-59bd-4a8e-a70c-ceaab68c9662 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:07:43.629041 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x557dbc5049c0 pid: 103361 (default app) Jun 27 21:08:58.318352 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:58.319509 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jun 27 21:08:58.320411 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 2/2] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:08:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:08:58.339039 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:58.340195 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:58.340888 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell1:SELECT=3 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:58.341704 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:08:58.794929 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-8dad11af-c6ae-4ccc-af26-e60950ba5e5c admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:08:58.836961 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-8dad11af-c6ae-4ccc-af26-e60950ba5e5c admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.507833 Jun 27 21:08:58.837744 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 1/3] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 27 21:08:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:00.893111 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:00.894118 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-9b4d3cdc-cc9f-4347-98bc-a30d03882490 None None] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jun 27 21:09:00.894471 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 3/4] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:00.954515 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1826120b-ca8e-45e2-88b7-1d72b5b2b187 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "cirros256", "disk": 1, "swap": 0, "id": "c1"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:00.972833 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:09:00.972833 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 27 21:09:01.004198 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1826120b-ca8e-45e2-88b7-1d72b5b2b187 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.101798 Jun 27 21:09:01.006199 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 2/5] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:00 2022] POST /compute/v2.1/flavors => generated 407 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 21:09:01.221395 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-df936bdf-f550-430b-a6e3-1e0885bb00ac admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:01.223857 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:09:01.223857 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:09:01.226581 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:01.227482 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:01.228484 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=3 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:01.229139 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:01.295196 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-df936bdf-f550-430b-a6e3-1e0885bb00ac admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.281667 Jun 27 21:09:01.295809 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 4/6] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 27 21:09:01 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:03.373797 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-1826120b-ca8e-45e2-88b7-1d72b5b2b187 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:03.374823 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-1826120b-ca8e-45e2-88b7-1d72b5b2b187 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Jun 27 21:09:03.375231 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 3/7] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:03.483434 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5b1c3012-80da-4288-b7f1-fe926e148b91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds512M", "swap": 0, "vcpus": 1, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "disk": 5, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:03.500652 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:09:03.500652 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:09:03.521763 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-5b1c3012-80da-4288-b7f1-fe926e148b91 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140434 Jun 27 21:09:03.523035 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 5/8] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:03 2022] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:03.535452 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-a1f42161-0246-40e7-b478-8f79280bae96 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:03.537048 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:09:03.537048 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: warnings.warn(msg) Jun 27 21:09:03.570191 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-a1f42161-0246-40e7-b478-8f79280bae96 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038991 Jun 27 21:09:03.570790 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 4/9] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 27 21:09:03 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:05.616231 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-5b1c3012-80da-4288-b7f1-fe926e148b91 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:05.617280 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-5b1c3012-80da-4288-b7f1-fe926e148b91 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Jun 27 21:09:05.617997 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 6/10] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:05.680114 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-3fb83b4d-e014-4d1a-bb38-1d0654e55381 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "id": "d2", "ram": 1024, "disk": 10, "name": "ds1G", "swap": 0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:05.698842 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-3fb83b4d-e014-4d1a-bb38-1d0654e55381 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075427 Jun 27 21:09:05.699648 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 5/11] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:05.711719 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-6b2ad2e8-8b91-431b-8dd6-ecf5f7492e57 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:05.735158 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-6b2ad2e8-8b91-431b-8dd6-ecf5f7492e57 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027343 Jun 27 21:09:05.735789 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 7/12] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 27 21:09:05 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:07.804491 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-3fb83b4d-e014-4d1a-bb38-1d0654e55381 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:07.805541 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-3fb83b4d-e014-4d1a-bb38-1d0654e55381 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001558 Jun 27 21:09:07.805942 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 6/13] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:07.864212 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a6a0c857-11a6-41d9-9f29-2b0b77e6e00f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "os-flavor-access:is_public": true, "id": "d3", "swap": 0, "ram": 2048, "disk": 10, "rxtx_factor": 1.0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:07.882384 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a6a0c857-11a6-41d9-9f29-2b0b77e6e00f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.070480 Jun 27 21:09:07.882935 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 8/14] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:07.895174 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-694fce20-ab41-4bef-a7b2-47e91f7a88f9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:07.919934 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-694fce20-ab41-4bef-a7b2-47e91f7a88f9 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028584 Jun 27 21:09:07.920514 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 7/15] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 27 21:09:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:09.989355 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-a6a0c857-11a6-41d9-9f29-2b0b77e6e00f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:09.990447 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-a6a0c857-11a6-41d9-9f29-2b0b77e6e00f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Jun 27 21:09:09.990845 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 9/16] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:10.055018 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "id": "d4", "vcpus": 4, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:10.072342 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.075488 Jun 27 21:09:10.072860 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 8/17] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:10.084983 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b2eeb6e4-ae58-4047-9b00-df3da78e062f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:10.108461 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b2eeb6e4-ae58-4047-9b00-df3da78e062f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027421 Jun 27 21:09:10.109050 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 10/18] 10.222.0.27 () {64 vars in 1335 bytes} [Mon Jun 27 21:09:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:12.191105 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:12.192496 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jun 27 21:09:12.193124 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 9/19] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:12.256676 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-527f7546-a168-4f73-ba3c-1a71768538a8 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:12.286735 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-527f7546-a168-4f73-ba3c-1a71768538a8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.087267 Jun 27 21:09:12.287937 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 11/20] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 27 21:09:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:14.375692 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:14.376686 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-dfb0354e-1081-4f20-8292-f59a55126db3 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jun 27 21:09:14.377079 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 10/21] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:14.446862 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4996e75e-d2d4-4f1c-bc3d-20f4a8766b10 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "rxtx_factor": 1.0, "ram": 512, "id": "1"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:14.467799 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4996e75e-d2d4-4f1c-bc3d-20f4a8766b10 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.084586 Jun 27 21:09:14.468396 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 12/22] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:14 2022] POST /compute/v2.1/flavors => generated 402 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 27 21:09:14.480522 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-5ab01193-b8f3-48fe-afec-c5c86372c9b5 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:14.506423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-5ab01193-b8f3-48fe-afec-c5c86372c9b5 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029449 Jun 27 21:09:14.506937 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 11/23] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:14 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:16.971807 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-4996e75e-d2d4-4f1c-bc3d-20f4a8766b10 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:16.972884 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-4996e75e-d2d4-4f1c-bc3d-20f4a8766b10 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001661 Jun 27 21:09:16.973301 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 13/24] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:17.041608 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-5fa35594-9f39-42c6-be04-b18d9fc7bf91 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "m1.small", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true, "id": "2", "disk": 20}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:17.064403 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-5fa35594-9f39-42c6-be04-b18d9fc7bf91 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.083260 Jun 27 21:09:17.064995 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 12/25] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:16 2022] POST /compute/v2.1/flavors => generated 405 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:17.077788 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ada6f787-572f-42e7-b96c-b8c01213f3d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:17.107197 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ada6f787-572f-42e7-b96c-b8c01213f3d2 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033214 Jun 27 21:09:17.108254 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 14/26] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:17 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:09:19.244611 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-5fa35594-9f39-42c6-be04-b18d9fc7bf91 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:19.245623 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-5fa35594-9f39-42c6-be04-b18d9fc7bf91 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001641 Jun 27 21:09:19.246038 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 13/27] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:19 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:09:19.313872 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e5409a46-9a9d-425f-94c1-6b95b8f7448f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "name": "m1.medium", "rxtx_factor": 1.0, "id": "3", "swap": 0}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:19.334459 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e5409a46-9a9d-425f-94c1-6b95b8f7448f admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.082232 Jun 27 21:09:19.335077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 15/28] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:19 2022] POST /compute/v2.1/flavors => generated 406 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:19.348278 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-4ec07762-416d-444c-a62d-bb989752d7ed admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:19.372353 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-4ec07762-416d-444c-a62d-bb989752d7ed admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028273 Jun 27 21:09:19.372947 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 14/29] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:21.434644 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e5409a46-9a9d-425f-94c1-6b95b8f7448f admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:21.435725 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e5409a46-9a9d-425f-94c1-6b95b8f7448f admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 27 21:09:21.436352 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 16/30] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:21.502069 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-68c6559d-05bf-4265-8193-fd7442b9e4c4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "vcpus": 4, "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "4", "disk": 80, "rxtx_factor": 1.0}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:21.524241 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-68c6559d-05bf-4265-8193-fd7442b9e4c4 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082004 Jun 27 21:09:21.524782 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 15/31] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:21 2022] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:21.536895 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-79ca33a5-1f6f-4ccc-9756-ef4154b80077 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:21.561203 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-79ca33a5-1f6f-4ccc-9756-ef4154b80077 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028033 Jun 27 21:09:21.561775 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 17/32] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:21 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:09:23.596613 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-68c6559d-05bf-4265-8193-fd7442b9e4c4 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:23.598220 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-68c6559d-05bf-4265-8193-fd7442b9e4c4 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002161 Jun 27 21:09:23.599748 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 16/33] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:23 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:23.659809 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "name": "m1.xlarge", "ram": 16384, "id": "5", "os-flavor-access:is_public": true, "vcpus": 8, "swap": 0, "disk": 160}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:23.679898 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.075121 Jun 27 21:09:23.681070 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 18/34] 10.222.0.27 () {64 vars in 1282 bytes} [Mon Jun 27 21:09:23 2022] POST /compute/v2.1/flavors => generated 408 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:23.692684 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-975eb944-6b73-49a4-97f7-5852aa1fe261 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:23.717485 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-975eb944-6b73-49a4-97f7-5852aa1fe261 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028583 Jun 27 21:09:23.718068 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 17/35] 10.222.0.27 () {64 vars in 1332 bytes} [Mon Jun 27 21:09:23 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:09:47.896527 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:47.897525 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 Jun 27 21:09:47.897912 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 19/36] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:09:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:47.909081 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:47.959575 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-d73e32dc-b4f9-4f52-a2ee-2da5865ed062 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:47.976677 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-d73e32dc-b4f9-4f52-a2ee-2da5865ed062 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072384 Jun 27 21:09:47.977206 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 18/37] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 27 21:09:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:48.888564 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:48.889587 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b44e375e-b5ac-4aec-890b-73e9d96583ae admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001569 Jun 27 21:09:48.889980 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 20/38] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:49.097467 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-8e1a6361-accc-4874-a7cc-155316a4ccaf admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:49.103764 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-8e1a6361-accc-4874-a7cc-155316a4ccaf admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-8e1a6361-accc-4874-a7cc-155316a4ccaf admin admin] Request method failure captured: Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.27 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABiuhycugnHlj6jL0THAjmK2IPRx94nMPlh8nSjGFBzhGWNmSGM1xkN6Kzo3p_zXIXWnmJarZRSiCUORfG7DybigkRpgv_Jr_rWBJMLsFEEn10h84iT-eYA-c6cuNJEydSyaADs1iEY0V3O7QOyF1g6oLSj3M7x33O1o0trgjw-T9sr9vM Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Role: admin,reader,member Jun 27 21:09:49.107037 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Roles: admin,reader,member Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: method: > Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: exception: Flavor 42 could not be found. Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '42'} Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:49.108738 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:49.109846 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.111407 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-8e1a6361-accc-4874-a7cc-155316a4ccaf admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:49.112713 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-8e1a6361-accc-4874-a7cc-155316a4ccaf admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.083112 Jun 27 21:09:49.112713 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 19/39] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:49.118346 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eab3f05d-b807-486a-b70a-4ccc2690af05 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:49.121322 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:09:49.140962 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eab3f05d-b807-486a-b70a-4ccc2690af05 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026198 Jun 27 21:09:49.141499 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 21/40] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:49.151934 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-0e651691-f75c-4f82-ab23-0645977c6c71 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:49.173144 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-0e651691-f75c-4f82-ab23-0645977c6c71 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025132 Jun 27 21:09:49.173645 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 20/41] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:49 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:49.183286 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b9dab503-7662-4f60-84cd-8b4d5675bae9 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:49.189773 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-b9dab503-7662-4f60-84cd-8b4d5675bae9 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b9dab503-7662-4f60-84cd-8b4d5675bae9 admin admin] Request method failure captured: Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.27 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiuhycugnHlj6jL0THAjmK2IPRx94nMPlh8nSjGFBzhGWNmSGM1xkN6Kzo3p_zXIXWnmJarZRSiCUORfG7DybigkRpgv_Jr_rWBJMLsFEEn10h84iT-eYA-c6cuNJEydSyaADs1iEY0V3O7QOyF1g6oLSj3M7x33O1o0trgjw-T9sr9vM Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Role: admin,reader,member Jun 27 21:09:49.193077 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Roles: admin,reader,member Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: method: > Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: exception: Flavor 42 could not be found. Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '42'} Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:49.194541 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:49.195478 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:49.196804 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b9dab503-7662-4f60-84cd-8b4d5675bae9 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:49.198011 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b9dab503-7662-4f60-84cd-8b4d5675bae9 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014762 Jun 27 21:09:49.198011 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 22/42] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:49 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:50.002595 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-0e651691-f75c-4f82-ab23-0645977c6c71 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:50.003682 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-0e651691-f75c-4f82-ab23-0645977c6c71 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 27 21:09:50.004059 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 21/43] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:50.205061 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-962daac4-cf5c-45dc-92f1-849df0fa3601 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:50.212650 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-962daac4-cf5c-45dc-92f1-849df0fa3601 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-962daac4-cf5c-45dc-92f1-849df0fa3601 admin admin] Request method failure captured: Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.27 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiuhyd7WJj_2L7OhhzsFAEZJoBnMcIAcWC9ThOndPJF_vDgfA0CULVXYx2V0KhXmo2EQLXWibdgHWkAH3uuXrWyvIwXqyNNDDt0WXfr3SU5sr3NBbCgHPiQQkbWTAXxV--szjQHVBU0PNgnFbXUjWVlk__y6KimBw41Wsn043tA-SPkAw Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Role: admin,reader,member Jun 27 21:09:50.214878 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Roles: admin,reader,member Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: method: > Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: exception: Flavor 84 could not be found. Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '84'} Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:50.216360 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:50.217406 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.218671 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-962daac4-cf5c-45dc-92f1-849df0fa3601 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:50.219998 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-962daac4-cf5c-45dc-92f1-849df0fa3601 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.071249 Jun 27 21:09:50.219998 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 23/44] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:50.226205 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-ebc84e78-7a93-487e-872e-9baad404daf1 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:50.240207 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-ebc84e78-7a93-487e-872e-9baad404daf1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017636 Jun 27 21:09:50.240753 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 22/45] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:50.250378 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-46b54773-e1cd-4d94-957f-ffa671eaf874 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:50.264481 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-46b54773-e1cd-4d94-957f-ffa671eaf874 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017632 Jun 27 21:09:50.265007 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 24/46] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:50 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:50.274662 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f62e2aea-5b4d-434a-8483-46641a18ac1a admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:50.280274 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-f62e2aea-5b4d-434a-8483-46641a18ac1a admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f62e2aea-5b4d-434a-8483-46641a18ac1a admin admin] Request method failure captured: Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.27 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABiuhyd7WJj_2L7OhhzsFAEZJoBnMcIAcWC9ThOndPJF_vDgfA0CULVXYx2V0KhXmo2EQLXWibdgHWkAH3uuXrWyvIwXqyNNDDt0WXfr3SU5sr3NBbCgHPiQQkbWTAXxV--szjQHVBU0PNgnFbXUjWVlk__y6KimBw41Wsn043tA-SPkAw Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Role: admin,reader,member Jun 27 21:09:50.281818 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Roles: admin,reader,member Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: method: > Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: exception: Flavor 84 could not be found. Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '84'} Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:50.283433 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:50.284423 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:50.285856 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-f62e2aea-5b4d-434a-8483-46641a18ac1a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:50.287060 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-f62e2aea-5b4d-434a-8483-46641a18ac1a admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012529 Jun 27 21:09:50.287060 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 23/47] 10.222.0.27 () {60 vars in 1190 bytes} [Mon Jun 27 21:09:50 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:51.097900 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-46b54773-e1cd-4d94-957f-ffa671eaf874 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:51.098925 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-46b54773-e1cd-4d94-957f-ffa671eaf874 admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 27 21:09:51.099321 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 25/48] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:51.303706 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-84b82466-d68b-44b8-9d81-d7df9ba83d7b admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:51.309739 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.wsgi [None req-84b82466-d68b-44b8-9d81-d7df9ba83d7b admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-84b82466-d68b-44b8-9d81-d7df9ba83d7b admin admin] Request method failure captured: Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept: application/json Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Accept-Encoding: gzip, deflate Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Connection: keep-alive Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Content-Length: 0 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Host: 10.222.0.27 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Openstack-System-Scope: None Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: User-Agent: python-novaclient Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Auth-Token: gAAAAABiuhyf-Hli5y8_bcCIjniMd1Y40qNezBwDf4q4H17REgGDSOPRT8dP6qvVFahTnXgmOgEBkt7E32mM4vdE1Y2xZOEHkt_XwNi_fKS7jsW3X2qAUa6QpZo5N4_eCPGfU3PolLn2QWm782T_1F2R73R0Rdo_x3K3slsI3vgi3Mpcb0WEwHA Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Id: None Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Domain-Name: None Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Identity-Status: Confirmed Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Is-Admin-Project: True Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Id: default Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Domain-Name: Default Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Project-Name: admin Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Role: admin,reader,member Jun 27 21:09:51.311236 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Roles: admin,reader,member Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant: admin Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-Tenant-Name: admin Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User: admin Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Id: default Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Domain-Name: Default Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: X-User-Name: admin Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: method: > Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: exception: Flavor 451 could not be found. Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: action_args: {'id': '451'} Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:51.312800 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:51.316471 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.317815 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-84b82466-d68b-44b8-9d81-d7df9ba83d7b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103361) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:51.319010 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-84b82466-d68b-44b8-9d81-d7df9ba83d7b admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.072411 Jun 27 21:09:51.319010 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 24/49] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:09:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:51.322428 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-69e44a6b-31a9-48e9-b251-9df6695f49d8 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:51.336384 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-69e44a6b-31a9-48e9-b251-9df6695f49d8 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017642 Jun 27 21:09:51.336910 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 26/50] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:51.346374 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:51.361465 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018583 Jun 27 21:09:51.361975 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 25/51] 10.222.0.27 () {60 vars in 1210 bytes} [Mon Jun 27 21:09:51 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:09:51.373859 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e0c54cde-95a8-4ea1-888d-fcea9353b790 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:51.381917 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.wsgi [None req-e0c54cde-95a8-4ea1-888d-fcea9353b790 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e0c54cde-95a8-4ea1-888d-fcea9353b790 admin admin] Request method failure captured: Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept: application/json Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Accept-Encoding: gzip, deflate Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Connection: keep-alive Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Content-Length: 0 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Host: 10.222.0.27 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-Api-Version: compute 2.90 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Openstack-System-Scope: None Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: User-Agent: python-novaclient Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Auth-Token: gAAAAABiuhyf-Hli5y8_bcCIjniMd1Y40qNezBwDf4q4H17REgGDSOPRT8dP6qvVFahTnXgmOgEBkt7E32mM4vdE1Y2xZOEHkt_XwNi_fKS7jsW3X2qAUa6QpZo5N4_eCPGfU3PolLn2QWm782T_1F2R73R0Rdo_x3K3slsI3vgi3Mpcb0WEwHA Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Id: None Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Domain-Name: None Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Identity-Status: Confirmed Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Is-Admin-Project: True Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Openstack-Nova-Api-Version: 2.90 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Id: default Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Domain-Name: Default Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Project-Name: admin Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Role: admin,reader,member Jun 27 21:09:51.384164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Roles: admin,reader,member Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/2213409bed61490ba55498fcd7bd10f8"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/2213409bed61490ba55498fcd7bd10f8"}]}] Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant: admin Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Id: 2213409bed61490ba55498fcd7bd10f8 Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-Tenant-Name: admin Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User: admin Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Id: default Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Domain-Name: Default Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Id: 3dc250d3d60a40d8b744430d137fcb9c Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: X-User-Name: admin Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: method: > Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: exception: Flavor 451 could not be found. Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: action_args: {'id': '451'} Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:09:51.385613 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:51.389116 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: ERROR nova.api.openstack.wsgi Jun 27 21:09:51.390402 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e0c54cde-95a8-4ea1-888d-fcea9353b790 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103360) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:09:51.391798 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e0c54cde-95a8-4ea1-888d-fcea9353b790 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.017495 Jun 27 21:09:51.391798 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 27/52] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:09:51 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 19 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 27 21:09:52.217102 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:52.218135 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 27 21:09:52.218489 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 26/53] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:52.420030 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-b8c9ba34-b431-432d-af23-2597e33c7b1d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:52.441404 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-b8c9ba34-b431-432d-af23-2597e33c7b1d admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.086302 Jun 27 21:09:52.441936 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 28/54] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:53.258187 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:53.259191 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001430 Jun 27 21:09:53.259583 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 27/55] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:53.465976 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-d23cc66a-81ea-43b6-b39d-09d3b0092b53 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:53.491374 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-d23cc66a-81ea-43b6-b39d-09d3b0092b53 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.096766 Jun 27 21:09:53.491942 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 29/56] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:54.312068 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:54.313108 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001549 Jun 27 21:09:54.313493 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 28/57] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:54.530161 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-dde7fc51-bbdb-4fd6-b6bc-b4fdeec65127 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:54.552365 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-dde7fc51-bbdb-4fd6-b6bc-b4fdeec65127 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.090698 Jun 27 21:09:54.552918 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 30/58] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:54 2022] POST /compute/v2.1/flavors => generated 407 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:55.374311 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:55.375327 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 27 21:09:55.375740 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 29/59] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:55.582667 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-e83c10e0-5168-4a58-b512-e964fb818736 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:09:55.603442 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-e83c10e0-5168-4a58-b512-e964fb818736 admin admin] 10.222.0.27 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.089418 Jun 27 21:09:55.604006 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 31/60] 10.222.0.27 () {64 vars in 1235 bytes} [Mon Jun 27 21:09:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:09:56.452664 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:56.453678 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 27 21:09:56.454064 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 30/61] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:09:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:09:56.649829 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-91036562-c3f5-49df-9f28-c111c60042d2 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:09:56.669822 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-91036562-c3f5-49df-9f28-c111c60042d2 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.078585 Jun 27 21:09:56.670278 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 32/62] 10.222.0.27 () {60 vars in 1202 bytes} [Mon Jun 27 21:09:56 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:10:43.187995 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.189007 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-99a7820b-ce82-47d7-94c2-5f4de426ecfe admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001483 Jun 27 21:10:43.189372 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 31/63] 10.222.0.27 () {54 vars in 930 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:10:43.200107 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:10:43.251557 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-dd912f57-53cc-4d92-b4f4-6d36c2274fe1 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.270793 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-dd912f57-53cc-4d92-b4f4-6d36c2274fe1 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075291 Jun 27 21:10:43.271330 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 33/64] 10.222.0.27 () {60 vars in 1291 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:10:43.296794 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-fee290fb-8017-4512-9505-28673846afe0 admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.302195 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG dbcounter [-] [103361] Writing DB stats nova_api:SELECT=14 {{(pid=103361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:10:43.310168 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-fee290fb-8017-4512-9505-28673846afe0 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.018595 Jun 27 21:10:43.310886 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 32/65] 10.222.0.27 () {60 vars in 1282 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:10:43.325768 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c725c7a0-a1e5-4655-af86-894be27e6b06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.333444 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c725c7a0-a1e5-4655-af86-894be27e6b06 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011307 Jun 27 21:10:43.333952 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 34/66] 10.222.0.27 () {60 vars in 1285 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:10:43.345459 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.353412 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011744 Jun 27 21:10:43.353914 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 33/67] 10.222.0.27 () {60 vars in 1285 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:10:43.364763 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-ea7bead8-c9b1-4ad8-a9b3-e5fec5122b06 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:10:43.372261 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-ea7bead8-c9b1-4ad8-a9b3-e5fec5122b06 admin admin] 10.222.0.27 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010818 Jun 27 21:10:43.372697 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 35/68] 10.222.0.27 () {60 vars in 1282 bytes} [Mon Jun 27 21:10:43 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:13:53.966365 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:53.967382 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Jun 27 21:13:53.967801 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 34/69] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:54.107286 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=6 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:13:54.239199 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:54.240412 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:54.240412 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:13:54.241606 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:54.242045 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:54.242820 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:54.243248 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:54.276690 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2bb61b56-ca94-4475-955b-7f757073f5f3 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.172166 Jun 27 21:13:54.277231 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 36/70] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:54 2022] GET /compute/v2.1/os-services => generated 791 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:13:55.081143 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:55.082144 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Jun 27 21:13:55.082532 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 35/71] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:13:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:13:55.287512 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:13:55.289142 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:13:55.289142 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:13:55.290945 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:55.291516 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:55.292706 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:13:55.293379 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:13:55.318151 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-c7241e8b-1cf1-48d2-bc87-18902322f956 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.096359 Jun 27 21:13:55.318694 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 37/72] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:13:55 2022] GET /compute/v2.1/os-services => generated 791 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:14:06.591404 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:14:06.592459 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Jun 27 21:14:06.592849 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 36/73] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:14:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:14:06.734440 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell0:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:14:06.735170 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_cell1:SELECT=4 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:14:06.735822 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG dbcounter [-] [103360] Writing DB stats nova_api:SELECT=8 {{(pid=103360) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:14:06.792652 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:14:06.793884 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:14:06.793884 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:14:06.795079 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:06.795521 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:06.796337 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:06.796768 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:06.821888 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-2349ce07-0312-43c1-b889-0d403e981b10 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.092004 Jun 27 21:14:06.822420 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 38/74] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:14:06 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:14:07.644664 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: DEBUG nova.api.openstack.wsgi [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] Calling method '>' {{(pid=103361) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:14:07.646218 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: INFO nova.api.openstack.requestlog [None req-7097c6cf-922b-4d9b-a44d-e15f45dcfe0d admin admin] 10.222.0.27 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002049 Jun 27 21:14:07.646632 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: [pid: 103361|app: 0|req: 37/75] 10.222.0.27 () {56 vars in 1074 bytes} [Mon Jun 27 21:14:07 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:14:07.853827 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG nova.api.openstack.wsgi [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] Calling method '>' {{(pid=103360) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:14:07.855164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 27 21:14:07.855164 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: warnings.warn(msg) Jun 27 21:14:07.856462 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:07.856947 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:07.857740 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:14:07.858169 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: DEBUG oslo_concurrency.lockutils [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103360) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:14:07.879806 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: INFO nova.api.openstack.requestlog [None req-eb46d30a-d961-4669-b0ef-6a3d7fa63970 admin admin] 10.222.0.27 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.093856 Jun 27 21:14:07.880352 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: [pid: 103360|app: 0|req: 39/76] 10.222.0.27 () {60 vars in 1193 bytes} [Mon Jun 27 21:14:07 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:15:04.221712 dv-cinder-847733-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 27 21:15:04.222254 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: Mon Jun 27 21:15:04 2022 - graceful shutdown triggered... Jun 27 21:15:04.222693 dv-cinder-847733-1-iscsi devstack@n-api.service[103361]: Gracefully killing worker 2 (pid: 103361)... Jun 27 21:15:04.223049 dv-cinder-847733-1-iscsi devstack@n-api.service[103360]: Gracefully killing worker 1 (pid: 103360)... Jun 27 21:15:05.223627 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: worker 1 buried after 1 seconds Jun 27 21:15:05.223627 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: worker 2 buried after 1 seconds Jun 27 21:15:05.223627 dv-cinder-847733-1-iscsi devstack@n-api.service[103359]: goodbye to uWSGI. Jun 27 21:15:05.225541 dv-cinder-847733-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 27 21:15:05.226111 dv-cinder-847733-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 27 21:15:05.229018 dv-cinder-847733-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 27 21:15:05.239793 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 27 21:15:05 2022] *** Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: nodename: dv-cinder-847733-1-iscsi Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: machine: x86_64 Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: clock source: unix Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: pcre jit disabled Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: detected number of CPU cores: 4 Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: current working directory: / Jun 27 21:15:05.241829 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: detected binary path: /usr/bin/uwsgi-core Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: your processes number limit is 47680 Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: your memory page size is 4096 bytes Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: detected max file descriptor number: 2048 Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: lock engine: pthread robust mutexes Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: thunder lock: enabled Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 27 21:15:05.242474 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 27 21:15:05.286521 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: Python main interpreter initialized at 0x55e6d4d719c0 Jun 27 21:15:05.286521 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: python threads support enabled Jun 27 21:15:05.286521 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: your server socket listen backlog is limited to 100 connections Jun 27 21:15:05.286521 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: your mercy for graceful operations on workers is 90 seconds Jun 27 21:15:05.286927 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: mapped 403077 bytes (393 KB) for 2 cores Jun 27 21:15:05.286927 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: *** Operational MODE: preforking *** Jun 27 21:15:05.287148 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: *** uWSGI is running in multiple interpreter mode *** Jun 27 21:15:05.287148 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: spawned uWSGI master process (pid: 117874) Jun 27 21:15:05.287255 dv-cinder-847733-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 27 21:15:05.287834 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: spawned uWSGI worker 1 (pid: 117892, cores: 1) Jun 27 21:15:05.288504 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: spawned uWSGI worker 2 (pid: 117893, cores: 1) Jun 27 21:15:05.288817 dv-cinder-847733-1-iscsi devstack@n-api.service[117874]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 27 21:15:05.937428 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:15:05.938418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 27 21:15:07.123577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:15:07.123577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: from cryptography.utils import int_from_bytes Jun 27 21:15:07.124301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:15:07.124301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: from cryptography.utils import int_from_bytes Jun 27 21:15:07.136880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:15:07.136880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: from cryptography.utils import int_from_bytes Jun 27 21:15:07.137856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 27 21:15:07.137856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: from cryptography.utils import int_from_bytes Jun 27 21:15:09.528187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:15:09.528804 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:15:09.528995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:15:09.529353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:15:09.529603 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:15:09.529960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.530311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.530621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.530941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.531264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.531572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.531895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.532208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.532535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.532788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.533099 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.533412 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-1-iscsi {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.533898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.534185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.534490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.534803 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.535085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.535399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.535725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.536224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.536678 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.536977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.537282 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.537616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.537936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.538243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.538544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.538849 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.539168 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.539473 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.539899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-1-iscsi {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.540214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.540535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.540819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.541234 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.541538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.541844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.542155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.542475 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.542778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.543118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.543432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.543766 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.544081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.544378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.544682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.544985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.545299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.545599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.545900 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.546143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.546439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.546757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.547075 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.547391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.547654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.547898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.548212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.548531 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.548828 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.549130 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.549533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.549840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.550104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 27 21:15:09.550604 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.550768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 27 21:15:09.550934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.550934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.551250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 27 21:15:09.552569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.552749 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 27 21:15:09.552902 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 27 21:15:09.553160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553358 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553457 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.553890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.554818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-847733-1-iscsi {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555705 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555866 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.555962 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556472 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.556911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.557990 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558602 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.558989 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559808 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.559914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560516 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.560797 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561010 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561309 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561403 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-847733-1-iscsi {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.561889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562276 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562520 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562730 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.562839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563207 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563396 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.563817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564398 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.564834 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565794 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.565894 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.566830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.567982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.568957 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569569 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569820 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.569999 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570401 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.570920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571529 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571855 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.571960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.572161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.572291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.572477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.572605 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.572811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.572923 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.573122 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.573222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.573442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.573551 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.573760 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.573852 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.574080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.574173 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.574391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.574483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.574711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.574804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.575011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.575105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.27 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.575321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.575420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.27 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.575653 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.575749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.575969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.576069 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.576278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.576381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.576585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.576687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.576899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.576990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.577212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.577312 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.577530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.577656 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.577828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.577923 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.578135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.578235 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.578445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.578555 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.578772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.578935 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.579067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.579163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.579315 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.579407 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.579627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.579731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.579950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.580040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.580271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.580678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.580935 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.581210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.581378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.581536 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.581698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.581845 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.582096 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.582246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.582400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.582555 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.582725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.582872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.583016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.583169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.583315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.583468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.587780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.587956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.588096 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.588212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.588353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.588594 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.588722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.588835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.589071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.589272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.589387 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.589514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.589635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.589754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.589872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.589992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.590111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.590230 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.590342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.590452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.590642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.590769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.590880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.590998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.591109 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.591218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.591336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.591448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.591558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.591717 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.591841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.591953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.592079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.592197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.592338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.592338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.592576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.592694 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.592814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.592934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.593045 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.593155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.593272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.593393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.593504 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.593627 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.594141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.594269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.594391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.594510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.594636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.594756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.594867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.594986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.595098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.595214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.595335 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.595458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.595576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.595729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.595865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.595996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.596137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.596311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.596441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.596570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.596697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.596831 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.596978 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.597114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.597249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.597376 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.597512 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.597655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.597805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 27 21:15:09.598028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598297 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598431 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.598956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.599160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.599314 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.599517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.599675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.599828 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600713 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.600968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601242 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601783 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.601924 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602189 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.602924 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.603758 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604672 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.604936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605071 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.605896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606134 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606853 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.606983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607118 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607772 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.607906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608263 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608808 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.608936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609289 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609419 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.609897 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610025 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610559 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.610953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611088 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.611762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.612317 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.612454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.612582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.612738 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.612896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613044 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.613961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.614466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.614617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.614771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615322 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.615994 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616424 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.616883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617488 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617716 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.617873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618171 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.618905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619049 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619192 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.619989 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620440 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620592 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.620924 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.621963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622615 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.622925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623207 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.623984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.624143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.624577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.624742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.624975 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625433 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625592 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.625889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.626042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.626194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.626349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.626508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.626672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.627311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.627494 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.627685 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.627849 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.628868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.629012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.629301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.629563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.629732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.629978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630431 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630575 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.630871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631666 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.631994 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632289 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.632886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633037 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633180 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633329 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.633931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.634228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.634646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.634813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.634984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635368 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635693 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.635996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636309 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.636904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.637923 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638387 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.638929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639083 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639554 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639799 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.639965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.640188 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.640361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.640513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.640850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.640996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641607 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.641900 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.642862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.643957 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.644107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.644261 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.644261 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.644816 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.644984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.645238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.645840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.645997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646582 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.646869 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647066 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647221 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647704 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.647991 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.648151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.648313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.648466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.648610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.648778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649317 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649474 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649618 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.649780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650206 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.650880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651810 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.651966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.652120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.652264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.653945 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.654090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.654241 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.654407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.654561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.654978 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.655129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.655274 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.655416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.655560 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.655768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656171 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656799 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.656954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657408 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657710 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.657864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658475 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.658934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659818 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.659982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.660195 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.660351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.660593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.660742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.660898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661336 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661645 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661789 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.661939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662402 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662555 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.662996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663596 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663596 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.663914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.664823 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665259 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665701 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.665844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.666248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.666404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.666557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.666708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.666852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667645 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.667958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668705 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.668849 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669003 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669171 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669717 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.669860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670002 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670153 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670433 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670608 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670832 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.670981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.671995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672607 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.672908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.673949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674619 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.674914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.675451 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.675634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.675795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.675941 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676263 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.676942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677386 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677530 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.677981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678667 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.678955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.679112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.679256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.679426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.679684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.679847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680305 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.680856 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.681832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682002 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682154 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.682889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.683034 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.683196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.683970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684298 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684760 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.684904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.685048 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.685522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.685676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.685820 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.685972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.686125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.686278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.686510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.686743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.686911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.687989 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.688142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.688288 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.688560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.688708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.688852 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689309 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.689866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690195 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.690874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.691916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692061 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692516 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.692963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.693990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.694140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.694284 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.694426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.694578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.694721 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.695124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.695289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.695766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.695929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696230 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696923 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.696923 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.697961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698412 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698707 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.698853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.699636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.700026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.700183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.700327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.703242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.703522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.703794 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.703958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704117 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.704888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.705042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.705186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.705186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.705471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.706846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707449 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707594 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.707926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708234 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.708963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.709881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.710932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711239 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711551 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711740 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.711900 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712568 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712714 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.712859 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.713230 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.713413 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.713568 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.713721 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.713867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714310 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714602 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.714899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.715054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.715210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.715374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.715527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.715721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.716811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.717971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718279 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718675 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.718972 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719118 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719560 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.719736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720595 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.720747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.721847 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.722881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.723050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.723050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.723501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.723693 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.723693 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.724947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.725241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.725392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.725392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.725709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.725861 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.726307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.726464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.726464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.726761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.726921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727074 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727234 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727234 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.727815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728134 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728450 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.728905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.729892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730605 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730694 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.730977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.731898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732016 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732489 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732608 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732608 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.732948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733075 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733449 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.733950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734100 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734239 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.734931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735447 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.735977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.736106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.736490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.736619 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.736732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.736889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737611 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737738 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.737961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738335 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738720 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.738954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739065 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.739890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740535 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740535 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740853 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.740973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741113 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.741547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742437 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.742892 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743346 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.743885 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744091 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744324 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744677 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.744908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745025 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745144 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745385 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745713 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.745962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.746984 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747158 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.747883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748377 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.748968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749750 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.749982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750440 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750567 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750680 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750680 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.750894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.751965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752580 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.752908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.753928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.754948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755312 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755424 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755536 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.755688 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.756392 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.756802 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.756922 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757284 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.757983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.758997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.759977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760372 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.760906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761170 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761800 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.761931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762060 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762472 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.762872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763158 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.763947 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764712 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.764843 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.765896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.766959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767102 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767485 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.767912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768066 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768971 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.768971 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.769879 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.770007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.770144 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.770280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.770280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.770863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771529 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.771848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772088 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772088 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.772893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773540 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.773996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.774852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775372 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.775939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776470 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776608 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.776751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.777987 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778858 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.778987 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.779915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780043 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780830 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.780830 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781091 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781227 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781491 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781491 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.781880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.782886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.783022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.783150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784068 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784068 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784800 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.784931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785693 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.785994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786712 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.786842 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787279 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.787972 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.788883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789409 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.789812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790078 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790744 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.790873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.791962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792811 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.792811 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793364 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793493 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793493 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.793871 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794008 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794302 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794302 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117893) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:15:09.794689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.794689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.795915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.795915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.795915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.795915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.796401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.796537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.796908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.797222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.797538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.797848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.798161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.798468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.798805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.799143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.799564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.799938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.800257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.800584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.800898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.801227 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.801551 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.801880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.802190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.802526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.802843 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.803158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.803472 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.803812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.804126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.804443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.804776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.805107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.805418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.805750 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.806071 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.806392 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.806711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.807026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.807362 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.807706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.808022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.808343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.808656 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.808971 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.809293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.809617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.809943 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.810272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.810585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.810917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.811247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.811620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.811946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.812294 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.812626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.812944 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.813261 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.813571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 27 21:15:09.813815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117892) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 27 21:15:09.857922 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Registered counter for database nova_api Jun 27 21:15:09.875126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO dbcounter [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Registered counter for database nova_api Jun 27 21:15:09.878576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:09.885801 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:09.895711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_db.sqlalchemy.engines [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:09.902670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writer thread running {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:09.942878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.context [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0f07735-a13a-4bd4-a3de-46acb69e68ee(cell1) {{(pid=117893) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:15:09.947003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:15:09.948615 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:15:09.949579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:15:09.951533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:15:09.953573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Registered counter for database nova_cell0 Jun 27 21:15:09.957713 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Registered counter for database nova_cell1 Jun 27 21:15:09.959448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.context [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c0f07735-a13a-4bd4-a3de-46acb69e68ee(cell1) {{(pid=117892) load_cells /opt/stack/nova/nova/context.py:464}} Jun 27 21:15:09.963628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:15:09.965200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:15:09.965355 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:09.966025 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:15:09.966833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:09.968723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:15:09.971755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO dbcounter [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Registered counter for database nova_cell0 Jun 27 21:15:09.975861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO dbcounter [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Registered counter for database nova_cell1 Jun 27 21:15:09.975997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:09.976262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:09.983091 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_db.sqlalchemy.engines [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:09.987879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writer thread running {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:09.991635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_db.sqlalchemy.engines [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:10.129893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO dbcounter [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Registered counter for database nova_cell0 Jun 27 21:15:10.133845 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writer thread running {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:10.136931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_db.sqlalchemy.engines [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117893) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:10.142163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writer thread running {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:10.144902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO dbcounter [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Registered counter for database nova_cell0 Jun 27 21:15:10.152215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_db.sqlalchemy.engines [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117892) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 27 21:15:10.156642 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writer thread running {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 27 21:15:10.458146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:15:10.465513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:10.467374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: WARNING keystonemiddleware.auth_token [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:15:10.474727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: WARNING keystonemiddleware.auth_token [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:10.808717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:15:10.814767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: WARNING keystonemiddleware.auth_token [None req-55cc1aa8-7d04-4067-aa81-1943616fefe1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:10.816226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: WARNING keystonemiddleware.auth_token [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 27 21:15:10.820314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6d4d719c0 pid: 117893 (default app) Jun 27 21:15:10.822808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: WARNING keystonemiddleware.auth_token [None req-01e70665-6283-49f3-9127-e984de6d3af5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 27 21:15:10.828116 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e6d4d719c0 pid: 117892 (default app) Jun 27 21:15:50.633400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:50.634594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:50.635817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:50.637920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:51.308732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:51.309548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:51.310855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:51.313451 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:15:52.421805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0e4ae5e7-bb3a-4cf8-b1f9-68b90ee8c8ae tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Action: 'create', calling method: .version_select at 0x7eff58297280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1264164670", "metadata": {"Type": "work"}}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0e4ae5e7-bb3a-4cf8-b1f9-68b90ee8c8ae tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 122 Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:52.458786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1264164670", "metadata": {"Type": "work"}}} Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:52.461322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1264164670', 'metadata': {'Type': 'work'}}}} Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi '#$%' Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:52.462291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:15:52.464563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:15:52.466011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 27 21:15:52.466011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.467622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0e4ae5e7-bb3a-4cf8-b1f9-68b90ee8c8ae tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:52.469427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0e4ae5e7-bb3a-4cf8-b1f9-68b90ee8c8ae tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.860065 Jun 27 21:15:52.476396 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 1/1] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 27 21:15:50 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1866 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:15:52.485726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8479f07-e61a-41a4-a1d4-4967a088c057 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Action: 'create', calling method: .version_select at 0x7eff5817d5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582975163", "metadata": {"Type": "work"}}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8479f07-e61a-41a4-a1d4-4967a088c057 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 119 Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:52.499458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-582975163", "metadata": {"Type": "work"}}} Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:52.501212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-582975163', 'metadata': {'Type': 'work'}}}} Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi '0' Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:52.502147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:15:52.503756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:15:52.506020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 27 21:15:52.506020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.506020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8479f07-e61a-41a4-a1d4-4967a088c057 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:52.507014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c8479f07-e61a-41a4-a1d4-4967a088c057 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.026825 Jun 27 21:15:52.510397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 2/2] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 27 21:15:52 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:15:52.522584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d4ffcd57-b6fb-4271-b587-0ef8cb777946 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Action: 'create', calling method: .version_select at 0x7eff582975e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1934055674", "metadata": {"Type": "work"}}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d4ffcd57-b6fb-4271-b587-0ef8cb777946 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 119 Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:52.532906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1934055674", "metadata": {"Type": "work"}}} Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:52.534289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1934055674', 'metadata': {'Type': 'work'}}}} Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise error Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi '' Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:52.535074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 27 21:15:52.536369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 27 21:15:52.537535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 27 21:15:52.537535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:52.542811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d4ffcd57-b6fb-4271-b587-0ef8cb777946 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:52.545616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d4ffcd57-b6fb-4271-b587-0ef8cb777946 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.030227 Jun 27 21:15:52.546895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 3/3] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 27 21:15:52 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 32 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:15:52.559999 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e5ed4102-271a-47fe-bdc6-e57af4cf217b tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Calling method '.version_select at 0x7eff58144280>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:52.914955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-718b97b1-7862-4bf4-93f9-d9151da70071 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Action: 'create', calling method: .version_select at 0x7eff58297280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-102501079", "metadata": {"Type": "work"}}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:15:53.261741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-e5ed4102-271a-47fe-bdc6-e57af4cf217b tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] HTTP exception thrown: Volume tempest-invalid-763153418 could not be found. Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e5ed4102-271a-47fe-bdc6-e57af4cf217b tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-763153418 HTTP/1.1 Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:53.266942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Volume tempest-invalid-763153418 could not be found. Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'tempest-invalid-763153418'} Jun 27 21:15:53.268511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-763153418 could not be found. (HTTP 404) (Request-ID: req-7686ccdf-05a0-449c-b22e-7c7fe2b20cf5) Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.269774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:15:53.271064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-763153418 could not be found. Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:15:53.272283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-763153418 could not be found. Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-763153418 could not be found. Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e5ed4102-271a-47fe-bdc6-e57af4cf217b tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 404 to user: Volume tempest-invalid-763153418 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e5ed4102-271a-47fe-bdc6-e57af4cf217b tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/tempest-invalid-763153418" status: 404 len: 98 microversion: 2.1 time: 0.715633 Jun 27 21:15:53.273423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 4/4] 10.222.0.27 () {58 vars in 1214 bytes} [Mon Jun 27 21:15:52 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-763153418 => generated 98 bytes in 720 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:15:53.311830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-523195ce-d2b3-49dc-8986-84bfcec819ab tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.029291 Jun 27 21:15:53.315455 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 5/5] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 27 21:15:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 34 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 21:15:53.326600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb0670e5-b8aa-4a60-bff8-15a1303729de tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006276 Jun 27 21:15:53.331820 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 6/6] 10.222.0.27 () {58 vars in 1136 bytes} [Mon Jun 27 21:15:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 27 21:15:53.343741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36f72374-2fc0-4478-8271-80b8e7be3ddd tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Calling method '.version_select at 0x7eff580ed670>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:53.407478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-36f72374-2fc0-4478-8271-80b8e7be3ddd tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] HTTP exception thrown: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36f72374-2fc0-4478-8271-80b8e7be3ddd tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/os-volumes/db5069a1-773a-4d7b-bd19-114978cba3db HTTP/1.1 Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:53.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'db5069a1-773a-4d7b-bd19-114978cba3db'} Jun 27 21:15:53.414655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. (HTTP 404) (Request-ID: req-209f5ed4-01d2-43e5-ac02-869a68991ea1) Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.415548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:15:53.416670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:15:53.417742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36f72374-2fc0-4478-8271-80b8e7be3ddd tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 404 to user: Volume db5069a1-773a-4d7b-bd19-114978cba3db could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-36f72374-2fc0-4478-8271-80b8e7be3ddd tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/db5069a1-773a-4d7b-bd19-114978cba3db" status: 404 len: 109 microversion: 2.1 time: 0.078342 Jun 27 21:15:53.418883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 7/7] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:15:53 2022] DELETE /compute/v2.1/os-volumes/db5069a1-773a-4d7b-bd19-114978cba3db => generated 109 bytes in 80 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:15:53.432081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9715a13-0697-4f3b-8304-0852d642a902 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Calling method '.version_select at 0x7eff5817dee0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:53.706720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-b9715a13-0697-4f3b-8304-0852d642a902 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] HTTP exception thrown: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9715a13-0697-4f3b-8304-0852d642a902 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Request method failure captured: Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/824a3462-a20d-4d55-875f-0a03d324fb09 HTTP/1.1 Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4GROAzZQqwwO4CSbkijultUOJMY6iJxpD_yMDmp3Jp4jDr9k5gR22cD0GNUotDMayM4I9dNM5TrLW-LonaXQVIS2A-Ay3q_cvZzqc7-WUDystoIYrvva1ggT6WFDRj6iNTBTHaLVm-qk9jDoAHQNhd38NRxLneFDnASCCBVTuHx_k Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:15:53.708984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/36fbf32e85d84d888f91e99337b3518b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/36fbf32e85d84d888f91e99337b3518b"}]}] Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 36fbf32e85d84d888f91e99337b3518b Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-1734052249 Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4ed0920154434d74b84fae18deff3449 Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-1734052249-project Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '824a3462-a20d-4d55-875f-0a03d324fb09'} Jun 27 21:15:53.710763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. (HTTP 404) (Request-ID: req-18181e0b-c9f0-4c79-b61a-4d370ddeffe8) Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.711914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:15:53.713411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:15:53.714755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9715a13-0697-4f3b-8304-0852d642a902 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] Returning 404 to user: Volume 824a3462-a20d-4d55-875f-0a03d324fb09 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9715a13-0697-4f3b-8304-0852d642a902 tempest-VolumesNegativeTest-1734052249 tempest-VolumesNegativeTest-1734052249-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/824a3462-a20d-4d55-875f-0a03d324fb09" status: 404 len: 109 microversion: 2.1 time: 0.293072 Jun 27 21:15:53.716042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 8/8] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:53 2022] GET /compute/v2.1/os-volumes/824a3462-a20d-4d55-875f-0a03d324fb09 => generated 109 bytes in 295 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:15:54.295185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-888da7cd-2556-4c3c-a215-319dbb0b5b59 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580ed280>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:54.515634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-718b97b1-7862-4bf4-93f9-d9151da70071 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.213512 Jun 27 21:15:54.516646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 1/9] 10.222.0.27 () {60 vars in 1155 bytes} [Mon Jun 27 21:15:51 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3216 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jun 27 21:15:54.531151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d20dd7d9-e50c-45a2-a774-805085aa62d0 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff5816d160>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:54.636498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-888da7cd-2556-4c3c-a215-319dbb0b5b59 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/4890ce33-639e-421e-9737-ceb8d9d1925a" status: 200 len: 351 microversion: 2.1 time: 0.345335 Jun 27 21:15:54.637509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 9/10] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:54 2022] GET /compute/v2.1/os-volumes/4890ce33-639e-421e-9737-ceb8d9d1925a => generated 351 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:15:54.758285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d20dd7d9-e50c-45a2-a774-805085aa62d0 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 200 len: 352 microversion: 2.1 time: 0.231140 Jun 27 21:15:54.758974 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 2/11] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:54 2022] GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 352 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:55.770667 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b8cd62c1-bb18-47bc-82e7-565789cc20e9 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff5817da60>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:55.879689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b8cd62c1-bb18-47bc-82e7-565789cc20e9 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 200 len: 353 microversion: 2.1 time: 0.113073 Jun 27 21:15:55.888265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 10/12] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:55 2022] GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 353 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:55.899960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-307fa86e-9fe7-4562-9a91-ade7ac4a0f71 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff5816d670>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:55.992107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-307fa86e-9fe7-4562-9a91-ade7ac4a0f71 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 200 len: 353 microversion: 2.1 time: 0.097273 Jun 27 21:15:55.993221 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 3/13] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:55 2022] GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 353 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:56.010151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a206d82f-1b02-4824-8920-272279fcc569 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff580ed8b0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:56.153819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a206d82f-1b02-4824-8920-272279fcc569 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 202 len: 0 microversion: 2.1 time: 0.147666 Jun 27 21:15:56.155327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 11/14] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:15:56 2022] DELETE /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 0 bytes in 150 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:15:56.164474 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-24cc17bc-20a4-4c98-978b-112cb08bde67 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff5816d8b0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:56.267430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-24cc17bc-20a4-4c98-978b-112cb08bde67 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 200 len: 352 microversion: 2.1 time: 0.107565 Jun 27 21:15:56.273016 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 4/15] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:56 2022] GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 352 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:57.013512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-72c9c6b3-25ef-451b-b5f3-43296225b1f6 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580ed5e0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:57.101172 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-72c9c6b3-25ef-451b-b5f3-43296225b1f6 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/01c99422-c909-46b1-a7e6-c1e7e93f4da6" status: 200 len: 350 microversion: 2.1 time: 0.091361 Jun 27 21:15:57.101702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 12/16] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:57 2022] GET /compute/v2.1/os-volumes/01c99422-c909-46b1-a7e6-c1e7e93f4da6 => generated 350 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:57.280301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1a8cc0fd-1e67-43f6-aa25-551a2a92ddf6 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Calling method '.version_select at 0x7eff5816df70>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:57.620249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-1a8cc0fd-1e67-43f6-aa25-551a2a92ddf6 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] HTTP exception thrown: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1a8cc0fd-1e67-43f6-aa25-551a2a92ddf6 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Request method failure captured: Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e HTTP/1.1 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4Hb_lADKFPosZyUGQpc72rOcrTiqvsD1LjYfqju6enZxxxJPJHlFjgm8sCKcrRl5gLxRmCx5PjmONLRdaYT-tTIsNLa59aO-yN3pA4L5MULFD3UrRyOxKlykZQwZZG3pp52giOs8h4cAGLa_mJty6FZK3ZvSGsVoMquc0-1eoSom4 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 474443a05dd94540931e136c5e5abc54 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-VolumesGetTestJSON-778329005 Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:15:57.624441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_474443a05dd94540931e136c5e5abc54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/474443a05dd94540931e136c5e5abc54"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/474443a05dd94540931e136c5e5abc54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/474443a05dd94540931e136c5e5abc54"}]}] Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-VolumesGetTestJSON-778329005 Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 474443a05dd94540931e136c5e5abc54 Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-VolumesGetTestJSON-778329005 Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-VolumesGetTestJSON-778329005-project Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 0dcfc6a4bdfa474a8aebfa593b466684 Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-VolumesGetTestJSON-778329005-project Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '298be3ea-6cff-4aed-9dff-10d149f8545e'} Jun 27 21:15:57.625826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. (HTTP 404) (Request-ID: req-e6c9a9d9-51fd-4e67-b1cc-f0959616f818) Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:57.626629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:15:57.627888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:15:57.629094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. Jun 27 21:15:57.630217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:15:57.633509 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1a8cc0fd-1e67-43f6-aa25-551a2a92ddf6 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] Returning 404 to user: Volume 298be3ea-6cff-4aed-9dff-10d149f8545e could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:15:57.633509 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1a8cc0fd-1e67-43f6-aa25-551a2a92ddf6 tempest-VolumesGetTestJSON-778329005 tempest-VolumesGetTestJSON-778329005-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e" status: 404 len: 109 microversion: 2.1 time: 0.356333 Jun 27 21:15:57.634469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 5/17] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:57 2022] GET /compute/v2.1/os-volumes/298be3ea-6cff-4aed-9dff-10d149f8545e => generated 109 bytes in 358 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:15:59.143744 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c22b19e6-53c6-4e47-aea4-c1ac369b730b tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580ed1f0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.281776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c22b19e6-53c6-4e47-aea4-c1ac369b730b tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/19695c8e-8caa-4d77-a645-7f154a5bb004" status: 200 len: 351 microversion: 2.1 time: 0.142983 Jun 27 21:15:59.282345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 13/18] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:15:59 2022] GET /compute/v2.1/os-volumes/19695c8e-8caa-4d77-a645-7f154a5bb004 => generated 351 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:59.294498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c0a40a2a-b4ac-4f00-a008-b2f2c5ded3da tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580c78b0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.462492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c0a40a2a-b4ac-4f00-a008-b2f2c5ded3da tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.172690 Jun 27 21:15:59.463505 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 6/19] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 27 21:15:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:15:59.478665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85aa335e-b303-4099-87a3-e616d19271c4 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580ed9d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.722869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85aa335e-b303-4099-87a3-e616d19271c4 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.250711 Jun 27 21:15:59.723452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 14/20] 10.222.0.27 () {58 vars in 1148 bytes} [Mon Jun 27 21:15:59 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:15:59.737940 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2699ca5b-df1b-405e-8ff5-cbe0182355f9 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff580c7d30>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:15:59.998172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2699ca5b-df1b-405e-8ff5-cbe0182355f9 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.266180 Jun 27 21:16:00.000155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 7/21] 10.222.0.27 () {58 vars in 1133 bytes} [Mon Jun 27 21:15:59 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:00.011662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5ad60a75-0655-4284-b906-2a067fbd37d8 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff5817d940>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:00.291269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5ad60a75-0655-4284-b906-2a067fbd37d8 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.283764 Jun 27 21:16:00.298305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 15/22] 10.222.0.27 () {58 vars in 1166 bytes} [Mon Jun 27 21:16:00 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:00.311786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-641f8cd0-d330-49a6-b113-98a11f6c9fba tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff5816dee0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:00.626794 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-641f8cd0-d330-49a6-b113-98a11f6c9fba tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.316756 Jun 27 21:16:00.628620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 8/23] 10.222.0.27 () {58 vars in 1169 bytes} [Mon Jun 27 21:16:00 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:00.654289 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ea44736e-4992-46fd-bf7f-b03d0f68b606 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff5816eaf0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:00.985980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ea44736e-4992-46fd-bf7f-b03d0f68b606 tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.345769 Jun 27 21:16:00.987257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 9/24] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 27 21:16:00 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:01.006452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-25507ec5-5609-4968-ad5e-7369748a15cf tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff5816e820>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:01.151935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1253980423", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "networks": [{"uuid": "09b45a6c-acd6-4df4-b903-8faa68028b2b"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:01.192617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-25507ec5-5609-4968-ad5e-7369748a15cf tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.198201 Jun 27 21:16:01.193300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 10/25] 10.222.0.27 () {58 vars in 1187 bytes} [Mon Jun 27 21:16:00 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:01.205971 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-80de7adf-a8c4-4549-9a26-4c219810e26f tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] Calling method '.version_select at 0x7eff58ad3790>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:01.406585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-80de7adf-a8c4-4549-9a26-4c219810e26f tempest-VolumesTestJSON-369864082 tempest-VolumesTestJSON-369864082-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.204207 Jun 27 21:16:01.407470 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 11/26] 10.222.0.27 () {58 vars in 1154 bytes} [Mon Jun 27 21:16:01 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:01.428178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] validate_networks() for [('09b45a6c-acd6-4df4-b903-8faa68028b2b', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:05.273904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:05.274472 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:05.274777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:05.275178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:05.275587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:05.293734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f02c7061-13b1-461c-bca7-76b684c506d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: .version_select at 0x7eff580c7940>, body: {"keypair": {"name": "tempest-keypair-1233059732", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBI52RqKWFM00D5JYQ6C9mrMUv/Tm3k6ATN/rZJEgxeDKNmiJhmjhM9TZRKBJT1FMAgut5in/tQwdmPCKQmM6ws3fh1lrjh37L4GQGthsFi7E9DTJElUgZupCNJb2hAP3A=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:05.329776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:05.330213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:05.331014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:05.331443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:05.429599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Getting quotas for project 0d49eb39209b4612aeb8b13eff382b84. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:05.433005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-f02c7061-13b1-461c-bca7-76b684c506d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:05.449767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Getting quotas for user 14307670704943768a05d7d6e5a7318b and project 0d49eb39209b4612aeb8b13eff382b84. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:05.462844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-f02c7061-13b1-461c-bca7-76b684c506d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for user 74b2295521bc45509ef6b68c1885ac6e and project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:05.484375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:05.487279 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:05.622677 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f02c7061-13b1-461c-bca7-76b684c506d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.267127 Jun 27 21:16:05.623264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 12/27] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 27 21:16:04 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1273 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 21:16:05.682494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fb391e2d-92d5-4bde-beb4-5c1ed2fe9af2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.261228 Jun 27 21:16:05.687481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 16/28] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 5268 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:05.697647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ab7b7c85-3f84-40d4-b2fa-6cac24ddd8f8 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:05.698819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ab7b7c85-3f84-40d4-b2fa-6cac24ddd8f8 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:05.979580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ab7b7c85-3f84-40d4-b2fa-6cac24ddd8f8 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:05.998062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ab7b7c85-3f84-40d4-b2fa-6cac24ddd8f8 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1215 microversion: 2.1 time: 0.304906 Jun 27 21:16:05.998681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 13/29] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:05 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1215 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:07.015663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0285f22c-d984-41ee-893f-16f12dcec439 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:07.016287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0285f22c-d984-41ee-893f-16f12dcec439 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:07.099131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-64caff53-3b4b-4db9-935a-5e27a66cd4fc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: .version_select at 0x7eff57778700>, body: {"keypair": {"name": "tempest-keypair-1616390398", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEsu2jss5lzk6k+/wOJOMH+7vYcu9l6kMLnBBY9hahBQ37Q+XExOOadNAE4it8RpEZg4ybJujYCPxGV5l3itaiWaq74TLYb0h3jb1HIBjjYaUyFWcaaR6vxSJc3+SQN/Eg=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:07.151319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-64caff53-3b4b-4db9-935a-5e27a66cd4fc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:07.167697 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-64caff53-3b4b-4db9-935a-5e27a66cd4fc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:07.220384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0285f22c-d984-41ee-893f-16f12dcec439 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:07.228329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0285f22c-d984-41ee-893f-16f12dcec439 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1215 microversion: 2.1 time: 0.217844 Jun 27 21:16:07.228932 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 14/30] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:07 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1215 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:07.276782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-64caff53-3b4b-4db9-935a-5e27a66cd4fc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.038924 Jun 27 21:16:07.279906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 17/31] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:16:06 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1043 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:08.249766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-86d6274e-af18-4199-91e3-48ecf876b702 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:08.251714 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-86d6274e-af18-4199-91e3-48ecf876b702 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:08.556123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-86d6274e-af18-4199-91e3-48ecf876b702 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:08.571962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-86d6274e-af18-4199-91e3-48ecf876b702 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1215 microversion: 2.1 time: 0.329879 Jun 27 21:16:08.583531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 15/32] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:08 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1215 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:09.597870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-508c251a-390c-40c7-a344-fd8952e4f218 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:09.599549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-508c251a-390c-40c7-a344-fd8952e4f218 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:09.862717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-508c251a-390c-40c7-a344-fd8952e4f218 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:09.933321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-508c251a-390c-40c7-a344-fd8952e4f218 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1215 microversion: 2.1 time: 0.342601 Jun 27 21:16:09.940081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 18/33] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:09 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1215 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:10.706016 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1862904439", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f1097eb-c5fa-4a13-a26e-fb4ec688ce90"}], "security_groups": [{"name": "tempest-securitygroup--1865268083"}], "key_name": "tempest-keypair-1233059732", "user_data": "}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:10.951313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:10.952740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:10.978075 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:10.986497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:10.987359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:10.987938 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:11.153439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] validate_networks() for [('9f1097eb-c5fa-4a13-a26e-fb4ec688ce90', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:11.535887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:11.564473 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e61ec6fd-fe41-4106-bd5f-439845a81641 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1275 microversion: 2.1 time: 0.617216 Jun 27 21:16:11.601040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 19/34] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:10 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1275 bytes in 653 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:12.606155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:12.606763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:12.619443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.619914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:12.623786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.625670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:12.886732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:12.887247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:12.887636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:12.889015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:12.889597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:12.909523 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.910407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:12.913789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:12.914483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:12.975279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:12.983484 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for user 74b2295521bc45509ef6b68c1885ac6e and project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:13.017209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:13.020933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:13.138768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:13.150227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-06aeb1fa-f158-4c68-acbf-a8e951d4ef97 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1273 microversion: 2.1 time: 0.548322 Jun 27 21:16:13.150736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 20/35] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:12 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1273 bytes in 550 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:13.276040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-99a92eda-fc94-414d-ba81-e4be685d021e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.576154 Jun 27 21:16:13.277253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 16/36] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 27 21:16:10 2022] POST /compute/v2.1/servers => generated 402 bytes in 2578 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 21:16:13.292937 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:13.293646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:14.123001 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:14.133847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:14.141031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:14.148536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c97047fa-13b0-4c12-b4d4-08269786f57d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1282 microversion: 2.20 time: 0.864055 Jun 27 21:16:14.152256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 21/37] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:13 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1282 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:14.179844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:14.183303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:14.204865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:14.206762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:14.208666 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:14.212868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:15.085777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:15.099004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-241c9941-9faa-403e-9bf9-fd3c771c37f0 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.932369 Jun 27 21:16:15.103463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 17/38] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:14 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:15.200527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:15.209512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:15.304223 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:15.316843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:15.318793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:15.320823 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-77a5ea9f-1c3a-4cab-9e55-8a8e44133d74 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1282 microversion: 2.20 time: 0.153591 Jun 27 21:16:15.332729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 22/39] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:15 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1282 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:15.506814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2053341945", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496540cf-a3b9-4c39-b571-4063a80b6b12"}], "security_groups": [{"name": "tempest-securitygroup--1238870892"}], "key_name": "tempest-keypair-1616390398", "user_data": "}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:15.783205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] validate_networks() for [('496540cf-a3b9-4c39-b571-4063a80b6b12', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:16:16.122795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:16.124081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:16.127219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:16.159862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:16.160662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:16.162210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:16.165247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:16.774978 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:16:16.775497 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:16:16.776448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:16:16.777020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:16:16.777576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:16:16.794232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:16.797316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:16.799145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:16.800873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:16.859343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:16:16.870530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:16:16.899361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:16:16.905239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:16:17.043876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a472df6c-30e7-488d-adc4-c09670bd5d51 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.541798 Jun 27 21:16:17.046028 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 18/40] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:16:15 2022] POST /compute/v2.1/servers => generated 402 bytes in 1545 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:16:17.089421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:17.090440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:17.100036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.101072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.103419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.104085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:17.165541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.177775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-68e2841e-26f0-4ce0-9899-f1e76e927325 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 1.060484 Jun 27 21:16:17.178542 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 23/41] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:16 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 1063 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:17.183067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e6407958-404f-4b58-baf7-3a910cf2c95d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:17.183689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e6407958-404f-4b58-baf7-3a910cf2c95d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:17.196227 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.206080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.207964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.209798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0619e89d-61d1-48fc-9f9e-bc34ac099292 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.161285 Jun 27 21:16:17.210970 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 19/42] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:17 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:17.320124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e6407958-404f-4b58-baf7-3a910cf2c95d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:17.328026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e6407958-404f-4b58-baf7-3a910cf2c95d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1242 microversion: 2.1 time: 0.148339 Jun 27 21:16:17.338833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 24/43] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:17 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1242 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:17.969724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-5a5302e8-70a0-4e64-9e10-925a54f540d6 req-01fb37f7-a52b-442b-9a97-ffb1466e837a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a644ea36-4828-4833-83ba-9b0a548ee9d8", "tag": "e1ab7ce3-1653-4b91-a7cb-d96ccb162de5"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:17.980980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5a5302e8-70a0-4e64-9e10-925a54f540d6 req-01fb37f7-a52b-442b-9a97-ffb1466e837a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:17.981419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5a5302e8-70a0-4e64-9e10-925a54f540d6 req-01fb37f7-a52b-442b-9a97-ffb1466e837a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.000498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-5a5302e8-70a0-4e64-9e10-925a54f540d6 req-01fb37f7-a52b-442b-9a97-ffb1466e837a service nova] Creating event network-changed:e1ab7ce3-1653-4b91-a7cb-d96ccb162de5 for instance a644ea36-4828-4833-83ba-9b0a548ee9d8 on hv-cinder-84773 Jun 27 21:16:18.001019 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5a5302e8-70a0-4e64-9e10-925a54f540d6 req-01fb37f7-a52b-442b-9a97-ffb1466e837a service nova] Acquired lock "compute-rpcapi-router" {{(pid=117892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 21:16:18.002098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.002535 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.003308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.003761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.012384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.compute.rpcapi [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 21:16:18.013184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] Releasing lock "compute-rpcapi-router" {{(pid=117892) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 21:16:18.029007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1b78a74f-3fb8-40e0-94bd-63e78dcbcb6c None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.118513 Jun 27 21:16:18.029576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 20/44] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:18.194997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:18.195594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:18.202082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.202573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.203338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.203812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.230153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:18.230956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:18.238039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.238549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.239523 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.239982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.311369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.319736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.321319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.322364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a6631901-e855-45b9-8f91-8e3dd1a40629 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.096500 Jun 27 21:16:18.322920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 21/45] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:18 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:18.338385 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.345916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7d0f3bae-6abd-4e22-af88-f021a784137f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.154838 Jun 27 21:16:18.346480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 25/46] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:18 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:18.348655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:18.349268 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:18.355261 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.355750 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.356528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:18.356968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:18.416206 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:18.423706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a12e4077-4ad3-4f84-a3ba-6bfd77a091d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.078930 Jun 27 21:16:18.424273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 22/47] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:18 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:19.340534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:19.341141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:19.348957 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.349626 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.350817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.351495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.362571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:19.363166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:19.369685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.370137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.370912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.371352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.415350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.423833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.425339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.426466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d724b581-8ee1-4d0e-9be3-5417f8b7a18a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.089851 Jun 27 21:16:19.427013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 26/48] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:19 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:19.441951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:19.442549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:19.448605 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.449041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.449743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:19.450199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:19.497936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.505480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ed860fbc-1c8e-4dc8-b174-8a1ea4cf3590 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.146861 Jun 27 21:16:19.506000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 23/49] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:19 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:19.512294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:19.520054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4cacb04a-d7f5-473a-88b9-e25a035af951 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.081733 Jun 27 21:16:19.520601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 27/50] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:19 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:20.445239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:20.445937 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:20.453314 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.454153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.455354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.455740 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.523324 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:20.524068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:20.536143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.537206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.541070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.541719 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.571897 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.581132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.590142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.593162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9c6458b8-43d2-4d08-a2c7-8d69438c62a1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.150806 Jun 27 21:16:20.593908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 24/51] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:20 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:20.603036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:20.607597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:20.619670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.621614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.622680 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:20.623343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:20.733820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.746831 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7803ed3e-9732-46f9-ab7f-ec6d4fcf7667 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.148876 Jun 27 21:16:20.749391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 25/52] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:20 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:20.847396 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:20.857594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cc8a09b5-a98a-4c77-b48b-c5ecc3562841 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.338851 Jun 27 21:16:20.858698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 28/53] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:20 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:21.611496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:21.612246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:21.619351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.620444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.621462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.621896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.693296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.701669 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.703367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.704517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f37be190-6bde-4cf2-b827-45342f3bedf1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.097111 Jun 27 21:16:21.705215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 26/54] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:21 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:21.766320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:21.766897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:21.774568 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.775007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.775817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.776243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.841095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:21.849071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5625c63c-55e7-448e-8eca-0028bb4d995f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.086619 Jun 27 21:16:21.849790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 29/55] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:21 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:21.878132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:21.879011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:21.886213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.886659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:21.887455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:21.887910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.048825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.056423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c41f9221-2b23-4139-8a61-deddbbfa7d95 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.184817 Jun 27 21:16:22.057004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 27/56] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:21 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:22.725897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:22.727591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:22.735345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.741762 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.743632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.744634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.812570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.822507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.824059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.825174 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ba15dee3-2a67-4f23-9a6a-6a6915a82cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.104003 Jun 27 21:16:22.825739 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 30/57] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:22 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:22.866713 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:22.867291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:22.873378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.873840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.874671 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:22.875096 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:22.952110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:22.959686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1d0fb8f5-7883-4b51-bf05-f1a4326718a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.096923 Jun 27 21:16:22.960254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 28/58] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:22 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:23.072911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:23.073513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:23.079780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.080221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.080983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.081411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.217011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.225296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f5f7e5c8-66bc-4e57-8714-90e5822341c3 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.156127 Jun 27 21:16:23.226254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 31/59] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:23 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:23.845931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:23.846545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:23.852716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.853172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.853942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.854368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.924724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.932854 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.934381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:23.935711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a5e1c04b-4f27-4bf2-943b-e0bd77b2edc1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.095762 Jun 27 21:16:23.950355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 29/60] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:23 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:23.977887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:23.978492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:23.992129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.992821 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:23.994369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:23.996134 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.077812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:24.092786 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3c506709-4bd7-4f13-abb4-9ff163aa7063 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.119444 Jun 27 21:16:24.102230 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 32/61] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:23 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:24.245424 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:24.246006 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:24.252415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.253124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.253879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.254329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.402915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:24.411882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d6cf07f6-b5e3-4b35-9d1a-c1e892ab9e3c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.171676 Jun 27 21:16:24.412432 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 30/62] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:24 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:24.955512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:24.956647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:24.972474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.973557 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:24.984252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:24.985642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.095647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.109107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:25.109993 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:25.113185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.115579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.116965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eaf389e8-c7df-42b4-93f2-141074b8c948 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.166195 Jun 27 21:16:25.130897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 33/63] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:24 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:25.145379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.145379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.145379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.145379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.275767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.286144 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9ec500c0-76b9-481d-b86a-622bd62f1007 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.180892 Jun 27 21:16:25.287746 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 31/64] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:25 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:25.437129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:25.437129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:25.440003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.440122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.443564 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:25.443564 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:25.613453 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:25.622072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3da72f74-b6d2-42c5-a253-f0e2e0a80ed7 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.193708 Jun 27 21:16:25.629228 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 34/65] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:25 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:26.136485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.137079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.143847 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.144290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.145232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.145805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.211019 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.219369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.221014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.222111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cd7dd24c-5eef-405f-bc0e-f5f2c2809f9a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.089492 Jun 27 21:16:26.222668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 32/66] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:26.303148 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.307151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.318534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.318993 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.319752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.320452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.388377 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.396275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aa5ae6e6-095b-4e4a-ae6e-5978384d176a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.096915 Jun 27 21:16:26.396823 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 35/67] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:26.639710 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:26.640400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:26.646794 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.647232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.648013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:26.648437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:26.890048 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=22 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:26.914141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:26.921543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-60dfd70b-87e6-4565-af7c-b179f1a9db3d tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.285843 Jun 27 21:16:26.922115 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 33/68] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:26 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:27.240652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.241233 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.248164 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.248745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.249576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.249996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.314656 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.322884 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.324416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.325513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a8bec6aa-16a0-4b21-b497-ecbb1da37a0e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.089327 Jun 27 21:16:27.326101 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 36/69] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:27.412700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.413307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.419241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.419712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.420460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.424146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.424914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:27.480763 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:27.488229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9fd077a0-319d-4830-ade3-669a8dea9fa5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.079314 Jun 27 21:16:27.488754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 34/70] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:27.937927 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:27.938519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:27.940362 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=18 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:27.945973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.946411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:27.947155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:27.947575 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.080269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.087675 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-563b7fb0-6663-4e6d-8932-e7edff671461 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.153554 Jun 27 21:16:28.088227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 37/71] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:27 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:28.343755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.344357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.346195 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:28.351465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.351940 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.352719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.353146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.423013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.431624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.433319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.435085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-96931b46-1616-4c1c-b604-e5504c243c6a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1334 microversion: 2.20 time: 0.095092 Jun 27 21:16:28.436556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 35/72] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1334 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:28.505095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:28.505734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:28.511944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.512376 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.513126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:28.513545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:28.517671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:28.576793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:28.585870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85ef7482-9de5-4e7f-bd75-d5b9c5799acb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1246 microversion: 2.1 time: 0.084578 Jun 27 21:16:28.586433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 38/73] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:28 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1246 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:29.105768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.107085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.114673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.115196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.116101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.116647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.244416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.251967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-442ba45e-f053-47d9-b762-22d1eafa8e49 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.151284 Jun 27 21:16:29.252576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 36/74] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:29.457814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.458728 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.468502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.468941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.469678 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.470098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.531223 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.539255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.540789 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.541870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-58968138-dfcf-44cb-ac15-de66c84eb006 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.090734 Jun 27 21:16:29.542761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 39/75] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:29.606660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:29.607693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:29.612542 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:29.618402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.619137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.620456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:29.621178 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:29.683837 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:29.691879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-537e72f9-8f7b-49f8-aca1-8011477fa592 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1294 microversion: 2.1 time: 0.091448 Jun 27 21:16:29.692480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 37/76] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:29 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:30.273122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:30.274137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:30.282780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.283216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.283994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.284428 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.410891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.418410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9b1f2e9-e9b6-4c6b-9303-98da345c458a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.152091 Jun 27 21:16:30.418973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 40/77] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:30.564041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:30.565059 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:30.575201 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.575992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.577222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.577648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.637912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.646303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.647824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.648910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c9de2d6f-04bf-4975-8b73-f4296d12cfbb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.091526 Jun 27 21:16:30.649453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 38/78] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:30.713282 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:30.714270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:30.717160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:30.726344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.727020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.728458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:30.729221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:30.798333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:30.809731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26774055-0c3d-4333-94fe-8746ac7132f2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1294 microversion: 2.1 time: 0.102917 Jun 27 21:16:30.810542 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 41/79] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:30 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1294 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:31.434347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.434959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.441357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.441798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.442563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.443191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.577500 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.585187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-76894203-cc52-4740-b9aa-92cc514ee701 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.154714 Jun 27 21:16:31.585758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 39/80] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:31 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:31.670445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.671265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.678710 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.679232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.680141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.680638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.749215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.758043 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.759531 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.760641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0a658d22-bb6e-4505-a59f-67c3041e8eee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.096936 Jun 27 21:16:31.761189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 42/81] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:31 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:31.831764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:31.832483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:31.839270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.839749 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.840528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:31.840960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:31.902459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:31.910712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-91b6b677-015f-44eb-b7d8-6df553e3272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1294 microversion: 2.1 time: 0.082717 Jun 27 21:16:31.911900 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 40/82] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:31 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1294 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:32.605907 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.606884 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.617490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.618291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.619523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.620333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.755432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.767850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-385ae046-8add-4fb9-9b11-d345b070c575 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.167907 Jun 27 21:16:32.769104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 43/83] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:32.781198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.781797 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.788219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.788785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.789572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.790017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.868105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.879417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.881899 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:32.883338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e9f6e2e5-29e0-428d-9682-fe7d91848ade tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.107706 Jun 27 21:16:32.884194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 41/84] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:32.928461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:32.929022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:32.935075 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.935572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.936275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:32.936695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:32.998210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.006206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-acfe1836-ee12-4418-8499-14e2e7436a5f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1294 microversion: 2.1 time: 0.081642 Jun 27 21:16:33.006764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 44/85] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:32 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:33.792925 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.793957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.800827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.801268 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.802026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.802468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.903649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:33.904246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:33.910927 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.911370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.912152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:33.912570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:33.942396 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.950583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-04e80396-da1e-451a-830f-4dcca6c59e0f tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.164129 Jun 27 21:16:33.951163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 42/86] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:33.975398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.983707 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.985247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:33.986374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c3a82f4b-43f2-43d9-8631-cc8e72541b42 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.086559 Jun 27 21:16:33.986908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 45/87] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:33 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:34.022739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.023354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.030007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.030459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.031228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.031700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.103672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:34.114448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c90f80de-83a0-4299-bf72-f17b282f7859 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1294 microversion: 2.1 time: 0.095710 Jun 27 21:16:34.115204 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 43/88] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1294 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:34.970465 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:34.970972 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:34.976748 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.977403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:34.978326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:34.979283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.003740 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.005162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.012166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.015572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.016659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.019011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.124360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.135238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.137208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.138827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-27159e0e-da91-4e85-95c6-f17144b508f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1340 microversion: 2.20 time: 0.139019 Jun 27 21:16:35.139759 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 44/89] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1340 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:35.155214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:35.156099 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:35.163813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.164573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.165517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:35.166075 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:35.250185 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.263575 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c3930511-76ad-4684-836e-5a27aa3170c2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1312 microversion: 2.1 time: 0.111775 Jun 27 21:16:35.264252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 45/90] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:35 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1312 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:35.308809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:35.316265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2165c3ee-ea00-48f1-a5ef-de4ae9776367 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.351184 Jun 27 21:16:35.316836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 46/91] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:34 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:36.168737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.169382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.190194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.190668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.191598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.192044 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.281970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.282775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.291875 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.292331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.298977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.299432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.399508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.409407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.412128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.417701 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-addf9606-b555-432f-987d-9f850869a705 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.260157 Jun 27 21:16:36.428752 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 46/92] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:36.434810 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:36.435672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:36.442952 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.443578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.444629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:36.445306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:36.571706 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.582315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-021b62a6-138a-4027-8bc3-48830526313a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.304657 Jun 27 21:16:36.583422 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 47/93] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:36.638618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:36.647306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-23e5d65a-38b7-4b05-b4f9-6a2097d73088 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.216947 Jun 27 21:16:36.648121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 47/94] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:36 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:37.438728 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.439494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.449996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.450833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.451992 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.452652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.602326 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.602934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.609344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.609791 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.610711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.611140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.723115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.732365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.734206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.735636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e8e15b2b-dddf-4271-9088-7c89c0d30217 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.303713 Jun 27 21:16:37.736244 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 48/95] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:37.740904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:37.741549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:37.750288 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.750839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.751691 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:37.752921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:37.971213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:37.978280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.001781 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d19e280e-b78d-417b-8a02-a6a4bc8666bd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.403089 Jun 27 21:16:38.006521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 48/96] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:38.034652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5f65368e-dff0-4c98-b024-3c60da6234fd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.296676 Jun 27 21:16:38.041687 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 49/97] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:37 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:38.379915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-163b0e2f-6861-4dfb-90b9-20e3e464d08f req-4175c215-4de6-4ded-8fe9-ea043b50cbbc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:38.431950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-163b0e2f-6861-4dfb-90b9-20e3e464d08f req-4175c215-4de6-4ded-8fe9-ea043b50cbbc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.436875 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-163b0e2f-6861-4dfb-90b9-20e3e464d08f req-4175c215-4de6-4ded-8fe9-ea043b50cbbc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.453286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-163b0e2f-6861-4dfb-90b9-20e3e464d08f req-4175c215-4de6-4ded-8fe9-ea043b50cbbc service nova] Creating event network-changed:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:16:38.460231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-163b0e2f-6861-4dfb-90b9-20e3e464d08f req-4175c215-4de6-4ded-8fe9-ea043b50cbbc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086014 Jun 27 21:16:38.461841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 49/98] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:38.762661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:38.763085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:38.774383 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.774996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.775949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.776584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.932476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-914d5b6e-fc21-46c2-b5bc-275eec06522b req-f2fce012-a4c3-4509-b481-831d8e3fcd08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad", "tag": "5def6202-f28e-4912-b70a-7bf64f620889"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:38.943141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-914d5b6e-fc21-46c2-b5bc-275eec06522b req-f2fce012-a4c3-4509-b481-831d8e3fcd08 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:38.943619 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-914d5b6e-fc21-46c2-b5bc-275eec06522b req-f2fce012-a4c3-4509-b481-831d8e3fcd08 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:38.955159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-914d5b6e-fc21-46c2-b5bc-275eec06522b req-f2fce012-a4c3-4509-b481-831d8e3fcd08 service nova] Creating event network-changed:5def6202-f28e-4912-b70a-7bf64f620889 for instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad on hv-cinder-84773 Jun 27 21:16:38.960381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-914d5b6e-fc21-46c2-b5bc-275eec06522b req-f2fce012-a4c3-4509-b481-831d8e3fcd08 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.130910 Jun 27 21:16:38.964580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 50/99] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:16:38.968146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.981761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.983654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:38.984934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fba26346-4b47-423b-ad18-1419566155d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.234665 Jun 27 21:16:38.985630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 50/100] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:38 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:39.021898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:39.022591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:39.028803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.030397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.031171 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.031630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.055727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:39.056347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:39.063736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.064189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.065022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:39.065454 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:39.218022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:39.222689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:39.227946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-def313f2-8371-4309-82cd-ae0f033975bd tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.178911 Jun 27 21:16:39.229063 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 51/101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:39 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:39.234578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3c0e061e-656f-4e43-9858-bd89626a7c56 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.217026 Jun 27 21:16:39.235215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 51/102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:39 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:40.003518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.004155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.010207 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.010643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.011559 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.012014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.152142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.162525 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.164199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.165383 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0762670-63a5-40f5-b8c1-6aa68349753e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.165808 Jun 27 21:16:40.166094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 52/103] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:39 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:40.245133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.247258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.252392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:40.253232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:40.253658 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.254124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.254867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.255313 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.259503 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:40.259822 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.260481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.261463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:40.261997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:40.399247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.412281 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-73fc840b-db05-4990-ae78-8b63e628644c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.163659 Jun 27 21:16:40.413717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 53/104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:40 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:40.434988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:40.442690 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-33655266-284f-4874-afc4-9fb23c7bf924 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.201532 Jun 27 21:16:40.443284 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 52/105] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:40 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:41.183752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.184477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.190800 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.191267 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.192066 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.192494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.325261 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.328709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:41.334760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.336380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.337605 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3a94f2a5-54fe-4dde-b23b-b3dcf5a1480b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.157762 Jun 27 21:16:41.338199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 54/106] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:41.430249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.430889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.438001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.438001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.438770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.439170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.462687 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:41.463880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:41.473824 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.474302 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.475272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:41.475837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:41.731513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.739712 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-34505b99-fbd3-49b7-a23e-a42f0ea82c9a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.283834 Jun 27 21:16:41.740489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 55/107] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:41.822817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:41.831055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-82a7f345-27dd-4d5d-b913-803f4dd8b47c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.404623 Jun 27 21:16:41.842122 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 53/108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:41 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:42.355750 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.356478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.362980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.363458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.364367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.365507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.501330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.509298 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.510782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:42.511889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bcaa26df-7b5a-4482-a445-87099260d7ae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.160092 Jun 27 21:16:42.512447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 56/109] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:42.756655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.757250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.763695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.764268 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.765220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.765714 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.848662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:42.849267 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:42.856191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.856627 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:42.857375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:42.858008 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.033911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.045197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c9f19cab-c2c3-4b0f-b81c-fd04cd7ed389 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.292119 Jun 27 21:16:43.045829 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 54/110] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:43.084394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.096654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c12d28aa-dcc2-429b-a52d-621863458a22 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.251693 Jun 27 21:16:43.099981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 57/111] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:42 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:43.530753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:43.531426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:43.540674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.541183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.543317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:43.545573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:43.727214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.764783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.766282 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:43.767510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-06eca3b0-08ba-4dd5-aefe-e65b92d2c17e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.241267 Jun 27 21:16:43.770540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 55/112] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:43 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:44.066201 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.068443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.080578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.082215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.086315 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.087053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.147810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-e768d8db-7d0c-4ad3-914e-3d4b7f4f7f56 req-6a51b7bf-f462-4d0e-be35-0b8855928b26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a644ea36-4828-4833-83ba-9b0a548ee9d8", "name": "network-vif-plugged", "status": "completed", "tag": "e1ab7ce3-1653-4b91-a7cb-d96ccb162de5"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:44.185706 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e768d8db-7d0c-4ad3-914e-3d4b7f4f7f56 req-6a51b7bf-f462-4d0e-be35-0b8855928b26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.186148 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e768d8db-7d0c-4ad3-914e-3d4b7f4f7f56 req-6a51b7bf-f462-4d0e-be35-0b8855928b26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.218262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-e768d8db-7d0c-4ad3-914e-3d4b7f4f7f56 req-6a51b7bf-f462-4d0e-be35-0b8855928b26 service nova] Creating event network-vif-plugged:e1ab7ce3-1653-4b91-a7cb-d96ccb162de5 for instance a644ea36-4828-4833-83ba-9b0a548ee9d8 on hv-cinder-84773 Jun 27 21:16:44.218708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e768d8db-7d0c-4ad3-914e-3d4b7f4f7f56 req-6a51b7bf-f462-4d0e-be35-0b8855928b26 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 27 21:16:44.220177 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.221023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.221949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.222669 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.233735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.compute.rpcapi [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 27 21:16:44.234860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] Releasing lock "compute-rpcapi-router" {{(pid=117893) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 27 21:16:44.252376 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a451bb34-d4d3-49fd-8c30-d2d3621f9189 None None] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.237220 Jun 27 21:16:44.256632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 58/113] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:44.262969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.265053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.273033 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.273411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.274345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.274749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.582649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.591018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56cf4d56-1e9d-4e06-bd18-991d1f8a89db tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.332824 Jun 27 21:16:44.593064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 59/114] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:44.739426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:44.748060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b849026f-762e-4dc2-aca1-214cd7b02865 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.689514 Jun 27 21:16:44.748841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 56/115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:44.788417 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:44.789362 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:44.803862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.807813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:44.808781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:44.815351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.048545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.059503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.061201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.062586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f3502b83-4daa-4853-af37-85785c4365c0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.280267 Jun 27 21:16:45.063344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 60/116] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:44 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:45.610848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.611443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.619558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.620315 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.621440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.621894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.761445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.765041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:45.765651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:45.773168 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.773813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.774881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:45.776082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:45.777990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2c3d0a36-85b5-483f-a6da-a3d318cc2586 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.171992 Jun 27 21:16:45.779170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 57/117] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:45.925040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:45.934195 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e2d4807c-3ffe-4f94-86ad-eb35d4187bb4 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.173057 Jun 27 21:16:45.935292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 61/118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:45 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:46.083317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.084102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.094613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.094613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.094613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.094613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.242593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.253360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.255223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.256660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cdf70d0c-0c98-4c2a-9b07-cd131654e4d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.178548 Jun 27 21:16:46.257858 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 58/119] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:46.796099 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.796706 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.803756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.804552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.805561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.806083 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.951298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:46.951929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:46.953028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:46.958188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.958621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.959739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:46.960313 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:46.961972 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-849b69f1-2abe-4584-b058-94847558695b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.170561 Jun 27 21:16:46.962684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 62/120] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:47.107364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.119465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-18b51371-131c-46e2-8458-e817752d8baa tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.173073 Jun 27 21:16:47.120077 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 59/121] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:46 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:16:47.276663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:47.277454 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:47.285050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.285637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.286670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:47.287233 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:47.812826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.838773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.842279 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:47.846545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-32e151e4-2f02-40cf-8447-474c5bb415fe tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.572816 Jun 27 21:16:47.847817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 63/122] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:47 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:16:47.979872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:47.981483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.019979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.020747 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.021913 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.022353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.137264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.137826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.146603 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.170217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.024s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.171833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.174201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.275789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.284967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2557c2f5-a98f-4628-bf32-45e51897203b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.308742 Jun 27 21:16:48.296049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 60/123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:47 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:48.407046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:48.418462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-807b9ba2-33d9-4016-aa74-091752593e88 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.285347 Jun 27 21:16:48.419052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 64/124] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:48.869609 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:48.870522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:48.883480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.884281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:48.886040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:48.887172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.124836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.134105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.135654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.136774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-54623be9-6b14-4b26-b6b3-e2782f10fcd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.273695 Jun 27 21:16:49.137332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 61/125] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:48 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:49.301814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.302419 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.309517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.310153 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.311133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.311764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.436911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:49.437587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:49.446266 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.446995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.449148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:49.449734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:49.490402 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.501692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1d8fd09b-2191-40ea-ae84-17e5a86c5fa3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.203269 Jun 27 21:16:49.503936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 65/126] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:49.625473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:49.633501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-38b55ee1-c55b-4bb6-8980-7fb8800e670e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1315 microversion: 2.1 time: 0.202213 Jun 27 21:16:49.634125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 62/127] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:49 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:50.154827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.155517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.165051 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.167985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.168936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.169727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.520283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.537746 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.538187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.551945 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.555327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.555994 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.568070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.569824 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.578095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ce6b1b8e-9132-4c15-bc28-0c3b6b0f9f72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.427641 Jun 27 21:16:50.588119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 66/128] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:50.650210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:50.650803 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:50.661224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.661931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.662843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.665926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.787249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.797297 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-08ce78e0-c2f7-4beb-8aec-4183d0239915 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.281720 Jun 27 21:16:50.798746 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 63/129] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:50.811149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-bddf653a-76a9-4d7a-8b40-eea606081c37 req-aab0a777-2e0a-47c5-a384-e90449191c26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad", "name": "network-vif-plugged", "status": "completed", "tag": "5def6202-f28e-4912-b70a-7bf64f620889"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:50.819846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-bddf653a-76a9-4d7a-8b40-eea606081c37 req-aab0a777-2e0a-47c5-a384-e90449191c26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:50.821156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-bddf653a-76a9-4d7a-8b40-eea606081c37 req-aab0a777-2e0a-47c5-a384-e90449191c26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:50.834430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-bddf653a-76a9-4d7a-8b40-eea606081c37 req-aab0a777-2e0a-47c5-a384-e90449191c26 service nova] Creating event network-vif-plugged:5def6202-f28e-4912-b70a-7bf64f620889 for instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad on hv-cinder-84773 Jun 27 21:16:50.841557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-bddf653a-76a9-4d7a-8b40-eea606081c37 req-aab0a777-2e0a-47c5-a384-e90449191c26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036813 Jun 27 21:16:50.842801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 64/130] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:50.874410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:50.888103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56c0d460-b4a4-412d-8bf9-17135924dd83 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1502 microversion: 2.1 time: 0.241489 Jun 27 21:16:50.888739 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 67/131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:50 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1502 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:51.600072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.600786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.608150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.608599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.612552 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.613479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.786942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.798770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.802979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:51.804698 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a040d09f-cada-46c6-9921-25b7e4e64d93 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.209996 Jun 27 21:16:51.806068 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 65/132] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:51.821528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:51.822951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:51.832259 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.832693 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:51.834200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:51.835277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.027794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:52.036856 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-14e159c5-2a21-4fc5-8309-2eea05e600b3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.219768 Jun 27 21:16:52.037515 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 68/133] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:51 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:52.415731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f6215266-9287-458f-b036-407d20799daa"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:52.416825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.422776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.423213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.424661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.425193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.823400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:52.824970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:52.832266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.833238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.834085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:52.834737 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:52.985923 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.003640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.005792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.007397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e2d173c9-6f48-40f3-bd2c-8a6f50befb33 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.188024 Jun 27 21:16:53.008202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 69/134] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:52 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:53.014257 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-9d9b6343-b81b-49a6-af87-7ad5c559c472 req-7ee6e7e2-8c30-4eb2-8280-c40d43e6f154 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "name": "network-vif-plugged", "status": "completed", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:53.024811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-9d9b6343-b81b-49a6-af87-7ad5c559c472 req-7ee6e7e2-8c30-4eb2-8280-c40d43e6f154 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.025435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-9d9b6343-b81b-49a6-af87-7ad5c559c472 req-7ee6e7e2-8c30-4eb2-8280-c40d43e6f154 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.038417 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-9d9b6343-b81b-49a6-af87-7ad5c559c472 req-7ee6e7e2-8c30-4eb2-8280-c40d43e6f154 service nova] Creating event network-vif-plugged:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:16:53.044373 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-9d9b6343-b81b-49a6-af87-7ad5c559c472 req-7ee6e7e2-8c30-4eb2-8280-c40d43e6f154 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034796 Jun 27 21:16:53.045456 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 70/135] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:53.056493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:53.057191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:53.064052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.064679 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.065431 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:53.066023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:53.265425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:53.275145 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2dcbb2f3-9570-4b30-bf78-08c4bfffcc85 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1368 microversion: 2.1 time: 0.223366 Jun 27 21:16:53.276889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 71/136] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:53 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1368 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:53.504533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d80969a0-84ae-42b6-bb08-d9aed9d2c7b2 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "POST /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.092599 Jun 27 21:16:53.509748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 66/137] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:16:52 2022] POST /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8/os-volume_attachments => generated 194 bytes in 1095 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:54.029359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.030964 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.040075 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.040787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.041723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.042459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.069137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:54.195337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.210178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.211924 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.213192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-841d1a49-955d-4efe-9f08-bb72bd775bbf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.189786 Jun 27 21:16:54.213932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 72/138] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:54.293300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.294106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.305668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.306111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.307179 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.307557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.488630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:54.501290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d345c8c7-ef4f-4abd-b7fd-f2a8700b1c0c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1559 microversion: 2.1 time: 0.212016 Jun 27 21:16:54.504293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 67/139] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1559 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:16:54.520344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:54.520729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:54.523108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:54.530578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.531015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.531881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:54.532462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:54.702714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3a2524c7-9aae-4fbb-b4f7-268ca27dc47b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.186530 Jun 27 21:16:54.703303 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 73/140] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:16:54 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-interface => generated 285 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:55.237676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:55.240776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:55.248031 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.248925 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:55.249897 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:55.250425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:55.275248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:16:55.772165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:55.781358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:55.784790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:55.787951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d1b1181b-b544-4812-b708-27fd15367b37 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1408 microversion: 2.20 time: 0.554706 Jun 27 21:16:55.796697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 68/141] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:55 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1408 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:56.414522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-8895279b-2257-43e1-bff8-bd0e766ef1fe req-6b9d5f2b-61a5-4ebd-82fc-cc1284eea112 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad", "tag": "5def6202-f28e-4912-b70a-7bf64f620889"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:56.435989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8895279b-2257-43e1-bff8-bd0e766ef1fe req-6b9d5f2b-61a5-4ebd-82fc-cc1284eea112 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.436528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8895279b-2257-43e1-bff8-bd0e766ef1fe req-6b9d5f2b-61a5-4ebd-82fc-cc1284eea112 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.455921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-8895279b-2257-43e1-bff8-bd0e766ef1fe req-6b9d5f2b-61a5-4ebd-82fc-cc1284eea112 service nova] Creating event network-changed:5def6202-f28e-4912-b70a-7bf64f620889 for instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad on hv-cinder-84773 Jun 27 21:16:56.462077 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-8895279b-2257-43e1-bff8-bd0e766ef1fe req-6b9d5f2b-61a5-4ebd-82fc-cc1284eea112 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051706 Jun 27 21:16:56.466659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 74/142] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:16:56.810178 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:56.811522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:56.822887 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.823555 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:56.824979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:56.826476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.066639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.074782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.076700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:16:57.078151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0b19f809-2952-4525-b869-d10852d45498 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1599 microversion: 2.20 time: 0.275582 Jun 27 21:16:57.079410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 69/143] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:16:56 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1599 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:16:57.097839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:16:57.098843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:16:57.111062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.113673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.116650 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:57.117463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:57.273964 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4b20fef9-872b-450d-b30d-4dbe5ebb46ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.180558 Jun 27 21:16:57.274900 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 75/144] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 27 21:16:57 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-interface => generated 284 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:16:59.004125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-e79e3ea1-a731-4ccd-be72-6548994d0c25 req-6ae5f80f-6df9-4db3-a179-09e3a595d93c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:16:59.034827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e79e3ea1-a731-4ccd-be72-6548994d0c25 req-6ae5f80f-6df9-4db3-a179-09e3a595d93c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:16:59.035281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e79e3ea1-a731-4ccd-be72-6548994d0c25 req-6ae5f80f-6df9-4db3-a179-09e3a595d93c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:16:59.052400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-e79e3ea1-a731-4ccd-be72-6548994d0c25 req-6ae5f80f-6df9-4db3-a179-09e3a595d93c service nova] Creating event network-changed:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:16:59.058183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-e79e3ea1-a731-4ccd-be72-6548994d0c25 req-6ae5f80f-6df9-4db3-a179-09e3a595d93c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058932 Jun 27 21:16:59.058836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 70/145] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:16:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:09.653547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:09.654714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:09.657486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=69 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:09.659019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=12 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:09.666379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.666887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.667821 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.668318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.705915 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:17:09.829599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-64da47da-9f54-4d61-aa65-ad7ba405ac47 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 204 len: 0 microversion: 2.1 time: 0.179708 Jun 27 21:17:09.831108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 76/146] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:17:09 2022] DELETE /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:17:09.841231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:09.843369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:09.850559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=66 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:09.851727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=12 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:09.854906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.855948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:09.860484 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:09.861655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:10.024008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:10.032948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f9bee157-f151-40c4-935d-41b99f921e14 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1554 microversion: 2.1 time: 0.197236 Jun 27 21:17:10.034262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 71/147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:09 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:11.054830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:11.055510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:11.062358 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.062794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.063544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:11.064163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:11.232929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:11.244227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e62cfdef-03b1-41ce-8cfb-6a5d533d5550 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1554 microversion: 2.1 time: 0.193486 Jun 27 21:17:11.244984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 77/148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:11 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1554 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:12.261090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:12.261613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:12.268628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.269067 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:12.269821 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:12.270248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:12.410443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:12.418257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e08cb14e-7910-4eff-ba02-dab688260212 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1554 microversion: 2.1 time: 0.161220 Jun 27 21:17:12.418833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 72/149] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:12 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:13.056734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-7d475041-08df-4070-9bba-ab220cfe804a req-33c8c9d7-815d-43a9-a77b-c36e9a5c6504 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a644ea36-4828-4833-83ba-9b0a548ee9d8", "name": "network-vif-deleted", "tag": "e1ab7ce3-1653-4b91-a7cb-d96ccb162de5"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:13.066668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-7d475041-08df-4070-9bba-ab220cfe804a req-33c8c9d7-815d-43a9-a77b-c36e9a5c6504 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:13.067149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-7d475041-08df-4070-9bba-ab220cfe804a req-33c8c9d7-815d-43a9-a77b-c36e9a5c6504 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.078951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-7d475041-08df-4070-9bba-ab220cfe804a req-33c8c9d7-815d-43a9-a77b-c36e9a5c6504 service nova] Creating event network-vif-deleted:e1ab7ce3-1653-4b91-a7cb-d96ccb162de5 for instance a644ea36-4828-4833-83ba-9b0a548ee9d8 on hv-cinder-84773 Jun 27 21:17:13.095025 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-7d475041-08df-4070-9bba-ab220cfe804a req-33c8c9d7-815d-43a9-a77b-c36e9a5c6504 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031671 Jun 27 21:17:13.101870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 78/150] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:13.436104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:13.437078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:13.452795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:13.453633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.454886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:13.455590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:13.532191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '14307670704943768a05d7d6e5a7318b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d49eb39209b4612aeb8b13eff382b84', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:13.542349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3264ab41-f3f4-456c-ab87-ed4d1304747e tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 200 len: 1346 microversion: 2.1 time: 0.111342 Jun 27 21:17:13.543097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 73/151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:13 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 1346 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:14.560446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:14.561308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:14.568058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.568540 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.569341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.570082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.584752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] HTTP exception thrown: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Request method failure captured: Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 HTTP/1.1 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4Pyrjjxr9uYGE3cEKhKGVrfinGwbYvrw09_rx0sq8zRPrc5WuRImGgltxcKEn2zaeWlgaTQ7Hav0O8eIi2jGGs4OAPMX0XWQhBtl-r9ogASGqvuDx6Qt-oaR6uL52Sm7d0nYPFBozKLgEsG2TAg9YmNKTYTclaJZ_WC0Y5lit3Lvo Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:17:14.592966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}] Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 14307670704943768a05d7d6e5a7318b Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.594157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'a644ea36-4828-4833-83ba-9b0a548ee9d8'} Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:14.594949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.596200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.597167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Returning 404 to user: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:14.597167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4bd4e62d-5704-46b1-9cd7-5483c1deef01 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.038854 Jun 27 21:17:14.598257 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 79/152] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:14 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:14.696324 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:14.697280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:14.704376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.704893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.705721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:14.706155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:14.719250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] HTTP exception thrown: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Request method failure captured: Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8/os-volume_attachments HTTP/1.1 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4Pyrjjxr9uYGE3cEKhKGVrfinGwbYvrw09_rx0sq8zRPrc5WuRImGgltxcKEn2zaeWlgaTQ7Hav0O8eIi2jGGs4OAPMX0XWQhBtl-r9ogASGqvuDx6Qt-oaR6uL52Sm7d0nYPFBozKLgEsG2TAg9YmNKTYTclaJZ_WC0Y5lit3Lvo Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:17:14.723506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}] Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 14307670704943768a05d7d6e5a7318b Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.724784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': 'a644ea36-4828-4833-83ba-9b0a548ee9d8'} Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:14.725465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:14.726606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:14.727908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Returning 404 to user: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:14.727908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-63bd19a3-6d37-475b-9841-2437031f498a tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.032611 Jun 27 21:17:14.727908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 74/153] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:17:14 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8/os-volume_attachments => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:18.036805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:18.037321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:18.043957 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.044391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.045141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.045563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.059411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] HTTP exception thrown: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Request method failure captured: Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 HTTP/1.1 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4Pyrjjxr9uYGE3cEKhKGVrfinGwbYvrw09_rx0sq8zRPrc5WuRImGgltxcKEn2zaeWlgaTQ7Hav0O8eIi2jGGs4OAPMX0XWQhBtl-r9ogASGqvuDx6Qt-oaR6uL52Sm7d0nYPFBozKLgEsG2TAg9YmNKTYTclaJZ_WC0Y5lit3Lvo Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:17:18.060960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}] Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 14307670704943768a05d7d6e5a7318b Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.062251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'a644ea36-4828-4833-83ba-9b0a548ee9d8'} Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:18.063200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.066777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.068045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Returning 404 to user: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:18.068045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b747fc98-f046-453c-8798-de759cefbd51 tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "DELETE /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.029806 Jun 27 21:17:18.068045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 80/154] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:17:18 2022] DELETE /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:18.071208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:18.071883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] [instance: a644ea36-4828-4833-83ba-9b0a548ee9d8] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:18.078511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.078943 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.079716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:18.080138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:18.094198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] HTTP exception thrown: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Request method failure captured: Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 HTTP/1.1 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4Pyrjjxr9uYGE3cEKhKGVrfinGwbYvrw09_rx0sq8zRPrc5WuRImGgltxcKEn2zaeWlgaTQ7Hav0O8eIi2jGGs4OAPMX0XWQhBtl-r9ogASGqvuDx6Qt-oaR6uL52Sm7d0nYPFBozKLgEsG2TAg9YmNKTYTclaJZ_WC0Y5lit3Lvo Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:17:18.096354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0d49eb39209b4612aeb8b13eff382b84"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0d49eb39209b4612aeb8b13eff382b84"}]}] Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0d49eb39209b4612aeb8b13eff382b84 Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-DeleteServersTestJSON-833570694 Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 14307670704943768a05d7d6e5a7318b Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-DeleteServersTestJSON-833570694-project Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.097756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'a644ea36-4828-4833-83ba-9b0a548ee9d8'} Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:18.098531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. Jun 27 21:17:18.099841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:17:18.100990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] Returning 404 to user: Instance a644ea36-4828-4833-83ba-9b0a548ee9d8 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:18.100990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0dc6b713-d2a7-4e1a-ae3b-ccb8d736dd7c tempest-DeleteServersTestJSON-833570694 tempest-DeleteServersTestJSON-833570694-project] 10.222.0.27 "GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8" status: 404 len: 111 microversion: 2.1 time: 0.030501 Jun 27 21:17:18.101836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 75/155] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:18 2022] GET /compute/v2.1/servers/a644ea36-4828-4833-83ba-9b0a548ee9d8 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:28.041292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=15,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:28.050465 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:28.100777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-697990157", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:28.192031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] validate_networks() for [('d0e7ca22-13aa-4b97-b402-60f0a6f6c4a5', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:17:28.736444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:17:28.736857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:17:28.737318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:17:28.737714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:17:28.738114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:17:28.751755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:28.752428 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:28.755495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:28.757362 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:28.785028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:17:28.798751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for user 92c1e4ea6ab84f94a2215f8c534ca159 and project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:17:28.811973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:17:28.814747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:17:28.893336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2ed391fb-adbe-4fe1-bde9-3b3173f95792 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.934640 Jun 27 21:17:28.894711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 81/156] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:17:27 2022] POST /compute/v2.1/servers => generated 383 bytes in 938 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:17:28.905055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-86379b76-c3b7-4758-a0e7-f40f9575dbd4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:28.905678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-86379b76-c3b7-4758-a0e7-f40f9575dbd4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:28.909163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=10 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:28.913699 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=22 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:29.026022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-86379b76-c3b7-4758-a0e7-f40f9575dbd4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:29.037218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-86379b76-c3b7-4758-a0e7-f40f9575dbd4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1221 microversion: 2.1 time: 0.136381 Jun 27 21:17:29.037764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 76/157] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:28 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1221 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:29.116506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1119995660", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:29.222615 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] validate_networks() for [('d0e7ca22-13aa-4b97-b402-60f0a6f6c4a5', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:17:29.702373 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:17:29.703007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:17:29.703545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:17:29.705771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:17:29.706452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:17:29.716117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:29.717040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:29.717925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:29.718587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:29.736354 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:17:29.740420 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for user 92c1e4ea6ab84f94a2215f8c534ca159 and project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:17:29.753476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:17:29.755954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:17:29.817561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9768bd41-6732-4300-b5e5-bbdc2e98c00a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.705477 Jun 27 21:17:29.818832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 82/158] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:17:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 707 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:17:29.828526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1d8b3d95-5c5f-4d72-9098-0d08c688f786 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:29.829152 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1d8b3d95-5c5f-4d72-9098-0d08c688f786 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:29.887437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1d8b3d95-5c5f-4d72-9098-0d08c688f786 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:29.895833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1d8b3d95-5c5f-4d72-9098-0d08c688f786 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1222 microversion: 2.1 time: 0.071009 Jun 27 21:17:29.906022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 77/159] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:29 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1222 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:30.914311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:30.915994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:30.924238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:30.924783 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:30.925829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:30.926461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:31.123787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:31.149401 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-87b689c9-7c57-49be-9906-507367b86471 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1274 microversion: 2.1 time: 0.239648 Jun 27 21:17:31.156503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 83/160] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:30 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1274 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:32.174020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:32.175256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:32.191576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:32.192403 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:32.193073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:32.193611 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:32.350745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:32.369746 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-65f66d92-f7e8-4268-ba71-768bc0f24b82 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1280 microversion: 2.1 time: 0.200737 Jun 27 21:17:32.381355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 78/161] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:32 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1280 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:33.235773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-dfd5b802-e830-4956-afc8-fe0a22dce1a5 req-dd5b2d9b-a033-41e5-bb60-bfb1de8e3d87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "49a3191b-7b8d-45c0-b7a7-a92591a03df0", "tag": "0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:33.262009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-dfd5b802-e830-4956-afc8-fe0a22dce1a5 req-dd5b2d9b-a033-41e5-bb60-bfb1de8e3d87 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:33.262704 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-dfd5b802-e830-4956-afc8-fe0a22dce1a5 req-dd5b2d9b-a033-41e5-bb60-bfb1de8e3d87 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:33.281288 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-dfd5b802-e830-4956-afc8-fe0a22dce1a5 req-dd5b2d9b-a033-41e5-bb60-bfb1de8e3d87 service nova] Creating event network-changed:0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33 for instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 on hv-cinder-84773 Jun 27 21:17:33.286468 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-dfd5b802-e830-4956-afc8-fe0a22dce1a5 req-dd5b2d9b-a033-41e5-bb60-bfb1de8e3d87 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061998 Jun 27 21:17:33.290828 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 84/162] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:33.386443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:33.387072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:33.407928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:33.408388 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:33.409187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:33.415433 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:33.857602 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:33.865906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-32e2005c-dee9-4ca4-85f6-0df176a59552 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.483495 Jun 27 21:17:33.877572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 79/163] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:33 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:34.359914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-319403ca-a147-4293-a8be-a62e5730c9d8 req-9f4155b8-ba34-49ce-882f-6e52f8b4af2f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "70f4d3a8-09f4-4af2-bc4d-cdde099122cc", "tag": "dde7eb9d-cc48-430f-8fba-2d67e531c828"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:34.371729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-319403ca-a147-4293-a8be-a62e5730c9d8 req-9f4155b8-ba34-49ce-882f-6e52f8b4af2f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.376659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-319403ca-a147-4293-a8be-a62e5730c9d8 req-9f4155b8-ba34-49ce-882f-6e52f8b4af2f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:34.402781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-319403ca-a147-4293-a8be-a62e5730c9d8 req-9f4155b8-ba34-49ce-882f-6e52f8b4af2f service nova] Creating event network-changed:dde7eb9d-cc48-430f-8fba-2d67e531c828 for instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc on hv-cinder-84773 Jun 27 21:17:34.419765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-319403ca-a147-4293-a8be-a62e5730c9d8 req-9f4155b8-ba34-49ce-882f-6e52f8b4af2f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056139 Jun 27 21:17:34.420469 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 85/164] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:34.575730 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1568274427", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:34.631717 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] validate_networks() for None {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:17:34.883238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:34.895806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:34.903391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.903989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:34.904832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:34.905328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:35.078136 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:35.094613 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c4c221e1-7b41-4d53-9e3c-b594013dea0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.215686 Jun 27 21:17:35.098313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 86/165] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:34 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:35.145654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:17:35.145654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:17:35.145654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:17:35.145654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:17:35.145654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:17:35.153360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:35.153755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:35.154531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:35.154950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:35.173439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Getting quotas for project 27b2158e24b0466c9b344c4f8c4f1301. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:17:35.177552 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Getting quotas for user cc12ebd7d75b460f9e520efcbad1aa11 and project 27b2158e24b0466c9b344c4f8c4f1301. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:17:35.188992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:17:35.191260 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:17:35.236883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-87b4acc9-6a09-4a48-9569-460676ea1fb3 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665106 Jun 27 21:17:35.237518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 80/166] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:17:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:17:35.250767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7d0092bb-6cef-4a79-9511-8763576550e9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:35.251649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7d0092bb-6cef-4a79-9511-8763576550e9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:35.396396 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7d0092bb-6cef-4a79-9511-8763576550e9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:35.403246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7d0092bb-6cef-4a79-9511-8763576550e9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1215 microversion: 2.1 time: 0.159706 Jun 27 21:17:35.403847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 87/167] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:35 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1215 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:36.114514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:36.115111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:36.123010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.123700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.124751 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.125185 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.270183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:36.280150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9fc4e382-4962-4e64-b7d9-2a8cfa684573 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.169551 Jun 27 21:17:36.280721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 81/168] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:36 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:36.420265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:36.420868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:36.427009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.427442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.428227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:36.428653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:36.504200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:36.512107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-09465949-3ca3-4c04-a9af-4e1844f97d88 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1267 microversion: 2.1 time: 0.095512 Jun 27 21:17:36.515726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 88/169] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:36 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1267 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:37.293160 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-666a7bed-6e99-4955-b46f-dbd197124f91 req-6cae28e3-f33a-4801-ac14-1f684adaf9cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a3191b-7b8d-45c0-b7a7-a92591a03df0", "name": "network-vif-plugged", "status": "completed", "tag": "0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:37.299738 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:37.300348 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:37.309009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.309648 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.310410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.310836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.312689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-666a7bed-6e99-4955-b46f-dbd197124f91 req-6cae28e3-f33a-4801-ac14-1f684adaf9cc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.313358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-666a7bed-6e99-4955-b46f-dbd197124f91 req-6cae28e3-f33a-4801-ac14-1f684adaf9cc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.327647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-666a7bed-6e99-4955-b46f-dbd197124f91 req-6cae28e3-f33a-4801-ac14-1f684adaf9cc service nova] Creating event network-vif-plugged:0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33 for instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 on hv-cinder-84773 Jun 27 21:17:37.335272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-666a7bed-6e99-4955-b46f-dbd197124f91 req-6cae28e3-f33a-4801-ac14-1f684adaf9cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047683 Jun 27 21:17:37.336072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 82/170] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:37.454237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:37.461835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d42e2f8a-9a10-4fcb-88c2-dbbe4c01ac17 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.167363 Jun 27 21:17:37.462393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 89/171] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:37 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:37.531639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:37.532624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:37.539156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.539804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.540643 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:37.541477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:37.612417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:37.620365 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9cda43d4-5ea1-447f-91a5-017a763668f2 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1285 microversion: 2.1 time: 0.093404 Jun 27 21:17:37.621209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 83/172] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:37 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1285 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:38.478657 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:38.479255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:38.486391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.486862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.487954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.488795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.638004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:38.639211 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:38.650072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.654045 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.655183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:38.656411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:38.679441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:38.689249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4568ac67-738a-41dc-8cf7-d948ec4c59d6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.214603 Jun 27 21:17:38.693670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 90/173] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:38 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:38.895902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:38.908468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b49852bf-c4ff-44a3-9868-f8e7abfe590b tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.274234 Jun 27 21:17:38.908983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 84/174] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:38 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:39.593329 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-a86119f2-43f1-48d3-9467-95868e3239cc req-94f14b7f-dbea-4b41-82eb-fff108dd529b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224", "tag": "584f6e3f-13e6-42cb-8f7d-66fedf00ceed"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:39.604677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a86119f2-43f1-48d3-9467-95868e3239cc req-94f14b7f-dbea-4b41-82eb-fff108dd529b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.605578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a86119f2-43f1-48d3-9467-95868e3239cc req-94f14b7f-dbea-4b41-82eb-fff108dd529b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:39.626535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-a86119f2-43f1-48d3-9467-95868e3239cc req-94f14b7f-dbea-4b41-82eb-fff108dd529b service nova] Creating event network-changed:584f6e3f-13e6-42cb-8f7d-66fedf00ceed for instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 on hv-cinder-84773 Jun 27 21:17:39.632822 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-a86119f2-43f1-48d3-9467-95868e3239cc req-94f14b7f-dbea-4b41-82eb-fff108dd529b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044293 Jun 27 21:17:39.634133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 91/175] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:39.718137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:39.718787 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:39.738516 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.739375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:39.741300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.741753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:39.922217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:39.926357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:39.927058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:39.935829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.936493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:39.937706 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:39.938441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:40.118954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:40.127814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1bccdf4b-d392-40f8-bd70-410528aa186d tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.206416 Jun 27 21:17:40.128398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 92/176] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:39 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:40.169719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:40.180116 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64017cb6-ed74-46d2-ab5a-e3a853df7f4c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.474528 Jun 27 21:17:40.180695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 85/177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:39 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:41.145104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:41.145698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:41.152021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.152506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.153218 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.153624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.214981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:41.217245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:41.233278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.234866 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.236395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.237454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.289236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:41.303389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5c9b0f1b-6598-4846-b187-4853f7d481ab tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.162305 Jun 27 21:17:41.304020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 93/178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:41 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:41.315134 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-bc5be334-ab09-4588-a454-61bf280aef67 req-e8dac7d8-b32d-4a59-aac1-e16c04e10e57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d3a8-09f4-4af2-bc4d-cdde099122cc", "name": "network-vif-plugged", "status": "completed", "tag": "dde7eb9d-cc48-430f-8fba-2d67e531c828"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:41.323927 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-bc5be334-ab09-4588-a454-61bf280aef67 req-e8dac7d8-b32d-4a59-aac1-e16c04e10e57 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:41.324360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-bc5be334-ab09-4588-a454-61bf280aef67 req-e8dac7d8-b32d-4a59-aac1-e16c04e10e57 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:41.337770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-bc5be334-ab09-4588-a454-61bf280aef67 req-e8dac7d8-b32d-4a59-aac1-e16c04e10e57 service nova] Creating event network-vif-plugged:dde7eb9d-cc48-430f-8fba-2d67e531c828 for instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc on hv-cinder-84773 Jun 27 21:17:41.343202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-bc5be334-ab09-4588-a454-61bf280aef67 req-e8dac7d8-b32d-4a59-aac1-e16c04e10e57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037862 Jun 27 21:17:41.344359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 94/179] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:41.425749 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:41.434181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4bc50895-2f21-49aa-b720-3e5e76e601aa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.238098 Jun 27 21:17:41.435055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 86/180] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:41 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:42.327360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:42.328541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:42.339138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.339742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:42.340501 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.340922 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:42.450372 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:42.450948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:42.457920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.458569 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:42.459637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:42.460089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:42.489163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:42.497480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bfaf7da1-8f6d-4dbc-be06-3e27bdf3427a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.177074 Jun 27 21:17:42.498272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 95/181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:42 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:42.612254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:42.619879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-467c9306-daae-4460-8643-e4a5ea1a90e6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.173419 Jun 27 21:17:42.620475 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 87/182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:42 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:43.515313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:43.516260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:43.522605 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:43.523042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:43.523910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:43.524338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:43.636934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:43.637604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:43.644970 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:43.645438 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:43.646233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:43.646661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:43.661654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:43.669664 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ff6fda98-d149-4273-83c4-959156c4d909 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.158325 Jun 27 21:17:43.670231 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 96/183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:43 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:43.775446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:43.783038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f8903414-3138-48bb-9329-5337dd715d9c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.150091 Jun 27 21:17:43.783634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 88/184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:43 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:44.112611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:44.113097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:44.119556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.120039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.120822 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.121374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.144914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-45884a48-d842-465e-9806-5e16da05280e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/ips" status: 200 len: 151 microversion: 2.1 time: 0.036110 Jun 27 21:17:44.145490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 97/185] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:17:44 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:44.688769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:44.689430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:44.698337 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.699035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.700095 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.700700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.800792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:44.801978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:44.808562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.808998 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.809749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:44.810182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:44.840427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:44.847987 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d5efa417-9e34-4060-bbec-9183c1ddac9c tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.164573 Jun 27 21:17:44.848587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 89/186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:44 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:44.939809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:44.947707 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b71f393-a23a-47eb-8ea1-368a22c5cb1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.151245 Jun 27 21:17:44.948259 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 98/187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:44 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:45.868906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:45.869863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:45.873033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:45.874196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=10 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:45.885359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.886203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:45.886964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.887397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:45.966905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:45.968115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:45.970402 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=14 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:45.983634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.984053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:45.985010 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:45.985434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.031033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:46.038721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c8aa9db7-09db-4e84-8d28-e7863f39404a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.176309 Jun 27 21:17:46.039289 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 90/188] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:45 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:46.133300 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:46.141795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aec5a018-bc6e-41b2-9c11-d621cfb16179 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1322 microversion: 2.1 time: 0.180041 Jun 27 21:17:46.142528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 99/189] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:45 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:46.566430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228cfdcc-77b7-454d-acb6-76b3aea91a40"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:46.567496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:46.574648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.575167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.576229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.576735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.619095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:46.619591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:46.631114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.631547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.632330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:46.632767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:46.677436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b5391860-38ec-46ba-8870-986677914ae3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/ips" status: 200 len: 151 microversion: 2.20 time: 0.063505 Jun 27 21:17:46.678643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 100/190] 10.222.0.27 () {60 vars in 1288 bytes} [Mon Jun 27 21:17:46 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/ips => generated 151 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:17:47.061752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:47.063180 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:47.074258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.074959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.075960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.076617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.233291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:47.240813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-944aeb96-9e26-4d7d-aa98-5df64e334785 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.189060 Jun 27 21:17:47.241360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 101/191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:47 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:47.245788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:47.246373 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:47.252393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.252822 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.253568 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.253986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.390586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:47.398936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-02e31bab-271a-47d8-8514-820453912508 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1516 microversion: 2.1 time: 0.156603 Jun 27 21:17:47.399521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 102/192] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:47 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1516 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:47.415393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:47.416397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:47.424598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.425046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.425813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.426271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.431025 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:47.451206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'flavor' on Instance uuid 70f4d3a8-09f4-4af2-bc4d-cdde099122cc {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:17:47.561677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f032dbff-d9a3-4c36-9942-3f2de187bab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc/action" status: 200 len: 32 microversion: 2.1 time: 0.150147 Jun 27 21:17:47.562441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 103/193] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:17:47 2022] POST /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc/action => generated 32 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:17:47.571398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:47.572114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:47.578631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.579070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.579860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:47.580289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:47.710812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:47.718485 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-116db75f-9f3e-41e8-80eb-05e646bcdae8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.151059 Jun 27 21:17:47.719018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 104/194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:47 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:48.257722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:48.258438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:48.264776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.265278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.266369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.266788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.426033 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:48.434593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-02f8f905-d5c1-4fea-bd2f-8958b5eb4a67 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.180508 Jun 27 21:17:48.435704 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 105/195] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:48 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:48.735521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:48.737349 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:48.747800 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.748379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.749213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:48.749948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:48.891829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:48.898447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cdc54086-3c22-4a46-bdf1-52396d1c6615 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.168011 Jun 27 21:17:48.899028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 106/196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:48 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:49.452009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:49.452619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:49.458862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.459290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:49.460078 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.460502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:49.599702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:49.607758 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d11d4e14-4b62-4eb5-ac6a-dab679f860a9 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.159606 Jun 27 21:17:49.608445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 107/197] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:49 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:49.863826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e0ad07f8-5351-47a1-9bd0-4d5e6b5971fd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.300829 Jun 27 21:17:49.864675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 91/198] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:17:46 2022] POST /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments => generated 194 bytes in 3303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:49.918930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:49.919651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:49.933292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.935255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:49.936664 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:49.938633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.022801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-8eb41a04-bf35-4a0d-8010-db141d78c9a4 req-ecb9fdac-31e6-4d3a-908d-67550c2be328 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224", "name": "network-vif-plugged", "status": "completed", "tag": "584f6e3f-13e6-42cb-8f7d-66fedf00ceed"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:50.037286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-8eb41a04-bf35-4a0d-8010-db141d78c9a4 req-ecb9fdac-31e6-4d3a-908d-67550c2be328 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:50.044864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-8eb41a04-bf35-4a0d-8010-db141d78c9a4 req-ecb9fdac-31e6-4d3a-908d-67550c2be328 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.058527 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-8eb41a04-bf35-4a0d-8010-db141d78c9a4 req-ecb9fdac-31e6-4d3a-908d-67550c2be328 service nova] Creating event network-vif-plugged:584f6e3f-13e6-42cb-8f7d-66fedf00ceed for instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 on hv-cinder-84773 Jun 27 21:17:50.074058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-8eb41a04-bf35-4a0d-8010-db141d78c9a4 req-ecb9fdac-31e6-4d3a-908d-67550c2be328 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054163 Jun 27 21:17:50.077875 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 92/199] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:17:50.265213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:50.274047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ad0c871-c69e-47e8-8b8f-c3289670d2d2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.361239 Jun 27 21:17:50.274849 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 108/200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:49 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:50.628072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:50.629406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:50.637556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:50.638299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.639236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:50.639698 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:50.843340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:50.851090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9acb593e-e417-4089-8d33-552c02e9519e tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.229794 Jun 27 21:17:50.851860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 93/201] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:50 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:51.290152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:51.290773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.296778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.297210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.297948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.298362 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.345576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:51.346124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.352524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.352967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.353764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.354228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.405485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lazy-loading 'flavor' on Instance uuid 07c8bb15-47a8-49ca-b240-c97ed0e24a43 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:17:51.451372 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:51.460393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ee59100-ac8d-45b4-bbfd-074276d7ac4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.173992 Jun 27 21:17:51.461237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 109/202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:51 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:51.461670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:51.722512 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bc141bf6-c17e-40cb-a4ce-744309d827d2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/action" status: 202 len: 0 microversion: 2.20 time: 0.380714 Jun 27 21:17:51.723273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 94/203] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 27 21:17:51 2022] POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/action => generated 0 bytes in 382 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:17:51.731506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:51.732145 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.738144 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.738768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.739715 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.740299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.870253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:51.870692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:51.877203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.877675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.878933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:51.879518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:51.882928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:51.893846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:51.895582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:51.896968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7c9a86b3-6e6f-4c71-bea5-de2e9f210207 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.169585 Jun 27 21:17:51.898028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 110/204] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:51 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:52.036459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:52.045011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-97943529-4874-4e43-9c48-7c394826b038 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.179628 Jun 27 21:17:52.055035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 95/205] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:51 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:52.478736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:52.479484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:52.489229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:52.489229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:52.489229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:52.489229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:52.624522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:52.632979 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-22b9578e-62dd-4466-a85f-b6f64f439b3d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.157941 Jun 27 21:17:52.633476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 111/206] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:52 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:52.916597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:52.917638 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:52.927007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:52.927648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:52.929152 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:52.929882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.063869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:53.064872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:53.072590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.073293 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.074256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.074583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.075198 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.083404 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.084947 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.086543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-08ad80db-9c09-4ae7-9c05-ff601223a19f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.174343 Jun 27 21:17:53.087254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 96/207] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:52 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:53.227572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.235575 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b3156c83-7beb-4870-80a2-fe03cfb0a146 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.177256 Jun 27 21:17:53.236236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 112/208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:53 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:53.650524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:53.651145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:53.657349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.657800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.658536 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:53.658959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:53.797521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:53.806213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-88289de4-2134-4b0f-bf92-8da1a73da69c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.159609 Jun 27 21:17:53.806789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 97/209] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:53 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:54.105247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:54.105879 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.112126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.112587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.113354 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.113771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.245353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:54.252518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:54.253188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.253880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:54.256220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:54.257581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b570b1fc-0b28-4f1a-acf8-0dd4aab88e45 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.156182 Jun 27 21:17:54.258383 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 113/210] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:54 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:54.260334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.260808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.261633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.262116 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.397985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:54.405563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7245ec4f-07a6-48de-a8ad-cf35bfb765b4 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1315 microversion: 2.1 time: 0.156917 Jun 27 21:17:54.406128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 98/211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:54 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:54.825028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:54.825673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:54.831794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.832243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.832994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:54.833448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:54.997305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.004694 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-62e36097-ec6f-484a-9397-2a4596f14e85 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.185083 Jun 27 21:17:55.005267 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 114/212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:54 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:55.277117 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.277857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.284636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.285220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.286092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.286678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.425959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.427118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.430949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.434032 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:55.439992 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.440610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.442043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.443103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.443733 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.443875 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.444891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ff4ae63a-3fbf-4e3f-945e-006655e2ea0a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.171711 Jun 27 21:17:55.445452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 99/213] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:55 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:55.620661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.629610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a179cdff-b1cf-46c4-ad9e-c1b7a71e9309 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1465 microversion: 2.1 time: 0.211114 Jun 27 21:17:55.630378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 115/214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:55 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1465 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:17:55.671887 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.671887 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.679220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.679691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.680461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.680895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.708495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:17:55.792542 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ac83cb8b-544d-4284-878e-5a69f8cedb58 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "DELETE /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 204 len: 0 microversion: 2.1 time: 0.126368 Jun 27 21:17:55.793573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 100/215] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:17:55 2022] DELETE /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:17:55.803915 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:55.804680 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:55.811910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.812477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.813384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:55.813905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:55.951936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:55.959698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6e5945a9-a6b5-4ba7-8a3d-b76b55fcbcc5 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1471 microversion: 2.1 time: 0.162019 Jun 27 21:17:55.960258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 116/216] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:55 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1471 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:56.022137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:56.022844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:56.029187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.029626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.030372 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.030795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.163367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:56.171177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d8717e42-3a20-4f5d-957f-97044e582b04 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.153172 Jun 27 21:17:56.171757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 101/217] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:56 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:56.463216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:56.463877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:56.469995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.470435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.471182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.471633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.612994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:56.616838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:56.623105 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:56.624657 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:56.625812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cc744d2e-9168-4c2e-9def-a8c41f6309a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.166720 Jun 27 21:17:56.626373 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 117/218] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:56 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:56.977374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:56.978105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:56.985257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.985696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:56.986461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:56.986919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.118139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.129425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-16196068-da2b-4c6f-b07d-798e052c317a tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1471 microversion: 2.1 time: 0.155823 Jun 27 21:17:57.129736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 102/219] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:56 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:57.189718 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:57.190750 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:57.200082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.200735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.201673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.202210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.341840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.349488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6fd9a7fb-4bb8-4822-a278-8554a722d325 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.164625 Jun 27 21:17:57.359108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 118/220] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:57 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:57.648374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:57.649356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:57.659251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.660051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.661288 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:57.661995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:57.884323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.893185 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.894677 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:57.895850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6f571a3e-77e0-4570-9de5-d656887ee3ad tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.254014 Jun 27 21:17:57.896377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 103/221] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:57 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:58.154803 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:58.156062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:58.162374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.162904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.163798 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.164379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.233843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc12ebd7d75b460f9e520efcbad1aa11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '27b2158e24b0466c9b344c4f8c4f1301', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:58.244723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-12064c39-3845-4fcd-b52d-dd84b5d6a298 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 200 len: 1429 microversion: 2.1 time: 0.101578 Jun 27 21:17:58.245307 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 119/222] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:58 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 1429 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:58.291138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-59b12e5f-5066-4a7e-b840-222eecdc5b8a req-e4cd88cf-dbc8-4ac7-adf4-0406403a50a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224", "name": "network-vif-deleted", "tag": "584f6e3f-13e6-42cb-8f7d-66fedf00ceed"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:17:58.305524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-59b12e5f-5066-4a7e-b840-222eecdc5b8a req-e4cd88cf-dbc8-4ac7-adf4-0406403a50a8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.305991 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-59b12e5f-5066-4a7e-b840-222eecdc5b8a req-e4cd88cf-dbc8-4ac7-adf4-0406403a50a8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.318623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-59b12e5f-5066-4a7e-b840-222eecdc5b8a req-e4cd88cf-dbc8-4ac7-adf4-0406403a50a8 service nova] Creating event network-vif-deleted:584f6e3f-13e6-42cb-8f7d-66fedf00ceed for instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 on hv-cinder-84773 Jun 27 21:17:58.326789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-59b12e5f-5066-4a7e-b840-222eecdc5b8a req-e4cd88cf-dbc8-4ac7-adf4-0406403a50a8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039245 Jun 27 21:17:58.327650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 104/223] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:17:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:17:58.366357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:58.367202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:58.378653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.379094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.379881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.380352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.543921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:58.551651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df79e5a9-66ae-4937-b33a-ff3bd50b4f07 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.189178 Jun 27 21:17:58.552224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 120/224] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:58 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:17:58.915587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:58.916453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:58.925112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.925719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:58.926484 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:58.927040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.066335 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:59.074332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:59.075843 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:59.076981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-982a760d-2654-4d1c-83ef-6b9b70866111 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.166417 Jun 27 21:17:59.077534 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 105/225] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:17:58 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:17:59.262559 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:59.263161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] [instance: bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:59.269644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.270142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.270833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.271256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.285320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] HTTP exception thrown: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Request method failure captured: Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 HTTP/1.1 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh5sG_KjsBx5g0krXSG-Z3ecU31PonfslKcQRlZE-V43HUPeY1xs-_c25pn7bGObBSetD5HK60-XTTBBqVAnmnmtnrp9RAAVdRPpp8u4yin_6plrhlu-MTPQaVzNV0n0vnILQ1TSro0ZRnq5Cec-ORkbbHcQVey0G1rlcgMcCKPwevk Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 27b2158e24b0466c9b344c4f8c4f1301 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesNegativeTest-26007690 Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:17:59.287029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_27b2158e24b0466c9b344c4f8c4f1301"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27b2158e24b0466c9b344c4f8c4f1301"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/27b2158e24b0466c9b344c4f8c4f1301"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/27b2158e24b0466c9b344c4f8c4f1301"}]}] Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesNegativeTest-26007690 Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 27b2158e24b0466c9b344c4f8c4f1301 Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesNegativeTest-26007690 Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesNegativeTest-26007690-project Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: cc12ebd7d75b460f9e520efcbad1aa11 Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesNegativeTest-26007690-project Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. Jun 27 21:17:59.288634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224'} Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:17:59.289619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. Jun 27 21:17:59.291030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:17:59.292720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] Returning 404 to user: Instance bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:17:59.292720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-96d811c5-1b8d-41d0-b4a9-714357c6f414 tempest-VolumesNegativeTest-26007690 tempest-VolumesNegativeTest-26007690-project] 10.222.0.27 "GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224" status: 404 len: 111 microversion: 2.1 time: 0.030395 Jun 27 21:17:59.292720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 121/226] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:59 2022] GET /compute/v2.1/servers/bdb54a1c-7a0e-4bbc-9165-a1e9a1ffc224 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:17:59.569154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:17:59.569773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:17:59.572594 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:17:59.578033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.578466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.579216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:17:59.579630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:17:59.712591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:17:59.720342 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e5842aa9-f5e1-46c3-8d95-021ed6cb87f5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.155618 Jun 27 21:17:59.720919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 106/227] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:17:59 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:00.094748 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:00.095414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:00.104296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:00.104915 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:00.106633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:00.107513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:00.266342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:00.274303 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:00.275897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:00.277232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6433fefc-915e-4218-b9cd-9fd2954f7957 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.186624 Jun 27 21:18:00.277816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 122/228] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:00 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:00.738423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:00.739308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:00.747655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:00.748107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:00.748884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:00.749318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:00.920010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:00.946399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c6c0bd2c-9fb8-45ea-b72d-95ce470bbc34 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.212640 Jun 27 21:18:00.947276 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 107/229] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:00 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:01.297930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:01.299076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:01.312590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:01.313736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:01.314759 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:01.315796 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:01.713543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2c250b87-f8a8-45e5-8a59-1fef396b000a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: .version_select at 0x7eff55bc5d30>, body: {"keypair": {"name": "tempest-keypair-1237033744", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ8d3gMqf47tOwV7NyDC71kGfxyACnsYb8fJafyPYt6ew0KzTdsRR8/OJqbXae84J0phL7QrXU7eE2oYxZNg2bFD28EatrK7AF0xU1M78cCUTj/SijtZnQkTXWgNEo4gXw=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:01.739788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-2c250b87-f8a8-45e5-8a59-1fef396b000a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:01.745675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-2c250b87-f8a8-45e5-8a59-1fef396b000a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:01.780436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2c250b87-f8a8-45e5-8a59-1fef396b000a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.071232 Jun 27 21:18:01.787455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 108/230] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:18:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:18:01.816803 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:01.827015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:01.831537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:01.832768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-561d9424-8de8-45ec-bb81-3820660931cf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.541386 Jun 27 21:18:01.836676 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 123/231] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:01 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:01.969080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:01.971134 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:01.987172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:01.989112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:01.990529 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:01.991455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:02.246650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:02.251347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:02.258112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9428ef85-125d-4780-8ef0-1d197702a1f2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.298143 Jun 27 21:18:02.258777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 109/232] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:01 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:02.850763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:02.852132 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:02.859187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:02.859652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:02.860419 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:02.861041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:03.074046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:03.084728 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:03.086623 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:03.088175 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2e4ee0ad-d873-45b2-bcb2-4208b45f08f5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.241350 Jun 27 21:18:03.089208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 124/233] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:02 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:03.279469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:03.281539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:03.290824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:03.291246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:03.292046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:03.292835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:03.639806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:03.648847 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-173ec4ba-b7a7-43dc-8867-8878313600e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.375008 Jun 27 21:18:03.658786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 110/234] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:03 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:03.831533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1472470457", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496540cf-a3b9-4c39-b571-4063a80b6b12"}], "security_groups": [{"name": "tempest-securitygroup--566561297"}], "key_name": "tempest-keypair-1237033744", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:03.942194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] validate_networks() for [('496540cf-a3b9-4c39-b571-4063a80b6b12', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:18:04.106256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:04.106851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:04.113299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.113853 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.114842 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.115276 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.279110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.290143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.291840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.293182 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-097f775f-6768-40ce-bbbb-d2d9ceac31d4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.190817 Jun 27 21:18:04.304408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 111/235] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:04 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:04.356100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:18:04.356512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:18:04.356971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:18:04.357366 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:18:04.357764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:18:04.367545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.368017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.368948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.369397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.388770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:04.393475 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:04.404832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:18:04.407167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:18:04.461714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-61112a32-daee-4c8b-8cbe-904101b768ff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.634461 Jun 27 21:18:04.462368 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 125/236] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:18:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:18:04.473591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f9f60e47-b5c0-4aa8-bd92-4ab68d0a6a69 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:04.474556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f9f60e47-b5c0-4aa8-bd92-4ab68d0a6a69 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:04.545969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f9f60e47-b5c0-4aa8-bd92-4ab68d0a6a69 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.556625 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f9f60e47-b5c0-4aa8-bd92-4ab68d0a6a69 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1242 microversion: 2.1 time: 0.087675 Jun 27 21:18:04.557361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 112/237] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:04 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:04.667502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:04.668226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:04.677373 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.678335 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.684602 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:04.688117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:04.850941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:04.858708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ce6aa1ec-dca8-4969-97f4-e75bde9b797a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.196186 Jun 27 21:18:04.859466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 126/238] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:04 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:05.314415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:05.315043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:05.323080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.323743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.324675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.325287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.458649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:05.467792 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:05.469374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:05.470758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-adb8ae1f-579e-407c-be45-6e68e8e38d5e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.160074 Jun 27 21:18:05.471334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 113/239] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:05 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:05.573850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:05.574422 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:05.581419 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.581859 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.582631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.583051 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.650555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:05.658133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4bff3cda-e34b-41e6-994a-096e5e33e7e8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1246 microversion: 2.1 time: 0.088211 Jun 27 21:18:05.658687 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 127/240] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:05 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:05.875676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:05.876478 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:05.882969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.883407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:05.884189 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:05.884611 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.035166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.043132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-104401bd-bff9-4837-a438-9569ffd211fd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.171293 Jun 27 21:18:06.043732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 114/241] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:05 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:06.494176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:06.494790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:06.501296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.501734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.502489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.502912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.635878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.644181 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.645745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.646848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-45ff6e4d-5a7c-4fbb-9287-8c140c95a79b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.159389 Jun 27 21:18:06.648255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 128/242] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:06 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:06.674172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:06.674773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:06.681394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.681829 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.682573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:06.682995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:06.899070 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:06.906880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c4c87642-95a6-485e-9f59-6a17b84cf38f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1246 microversion: 2.1 time: 0.236484 Jun 27 21:18:06.907436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 115/243] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:06 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1246 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:07.060213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:07.060814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:07.067285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.067749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.068493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.068917 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.207671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.215946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16e15efd-145f-42ec-af37-ae0188818ad8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.159614 Jun 27 21:18:07.216604 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 129/244] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:07 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:07.667429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:07.668442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:07.676226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.676801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.677736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.678968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.881396 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.891469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.893765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:07.894981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c8a4b603-2035-49cd-8f14-9be0338c5ee7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.231622 Jun 27 21:18:07.895546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 116/245] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:07 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:07.923788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:07.924398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:07.930894 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.931341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:07.932225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:07.932674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.003561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:08.012108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fcba7960-7f7e-4928-91e2-44eca7891be4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1294 microversion: 2.1 time: 0.092128 Jun 27 21:18:08.012777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 130/246] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:07 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1294 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:08.234318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:08.235133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:08.241977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.242647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.243582 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.244259 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.499860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:08.507239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-da9ead46-c934-40d9-a707-a83eafca01fb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.278031 Jun 27 21:18:08.507800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 117/247] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:08 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:08.919946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:08.920556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:08.926555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.927112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:08.927754 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:08.928176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.030851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:09.031421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.038095 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.038532 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.039292 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.039751 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.156863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.168921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.170956 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.172753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ab72b879-0989-430f-ba1c-b7f0e24eed97 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.262139 Jun 27 21:18:09.173473 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 131/248] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:08 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:09.238755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.252902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-872c90a4-db67-4f24-80c9-27d625931c02 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.225263 Jun 27 21:18:09.258208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 118/249] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:09 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:09.524906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:09.525517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:09.531888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.532332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.533113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:09.533541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:09.741521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:09.751156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26dbc352-dac6-43bf-b142-7626bd0946bf tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.230557 Jun 27 21:18:09.752368 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 132/250] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:09 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:10.038356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-2d8cdbd9-fa38-4d6c-8246-717cbe7a8da3 req-e09d4923-3393-4b5d-9d2f-a545cfeb00a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c714031-7635-4b59-bf82-3fa3a17deb64", "tag": "e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:10.047857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-2d8cdbd9-fa38-4d6c-8246-717cbe7a8da3 req-e09d4923-3393-4b5d-9d2f-a545cfeb00a4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.048296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-2d8cdbd9-fa38-4d6c-8246-717cbe7a8da3 req-e09d4923-3393-4b5d-9d2f-a545cfeb00a4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.062624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-2d8cdbd9-fa38-4d6c-8246-717cbe7a8da3 req-e09d4923-3393-4b5d-9d2f-a545cfeb00a4 service nova] Creating event network-changed:e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44 for instance 7c714031-7635-4b59-bf82-3fa3a17deb64 on hv-cinder-84773 Jun 27 21:18:10.070737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-2d8cdbd9-fa38-4d6c-8246-717cbe7a8da3 req-e09d4923-3393-4b5d-9d2f-a545cfeb00a4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036648 Jun 27 21:18:10.071988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 119/251] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:10.195516 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:10.196186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:10.202727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.203165 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.203969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.204377 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.272606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:10.273437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:10.279894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.280340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.281175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.281869 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.435546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.443301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4aeb6814-bce8-42f4-8866-83495dbb72e5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.174965 Jun 27 21:18:10.444638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.444801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 120/252] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:10 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:10.460768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.463537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.465425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-27dc08be-f7c3-427f-9f31-dca1f2c1e9df tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.274023 Jun 27 21:18:10.477418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 133/253] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:10 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:10.769175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:10.769899 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:10.776603 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.777121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.777963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:10.778479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:10.921581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:10.930424 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a483eaa7-02ac-4257-89a3-9222dcfb0927 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.165221 Jun 27 21:18:10.931168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 121/254] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:10 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:11.461296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.462731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.468960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.469396 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.470328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.470770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.484311 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.485021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.500742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.501187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.501964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.502389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.661410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.670813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-892a78e7-00a0-47c2-b100-5019325bdfba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.213259 Jun 27 21:18:11.671479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 134/255] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:11.716958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.734833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.736352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:11.737524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6c30dc06-9538-492f-8503-5a4a3ef9819a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1745 microversion: 2.20 time: 0.257226 Jun 27 21:18:11.750401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 122/256] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1745 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:11.946607 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:11.947244 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:11.953668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.954434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:11.955341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:11.955936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.120701 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.125393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:12.130517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3d0091c9-b610-483e-8daf-81d31cbf9a1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.187831 Jun 27 21:18:12.131193 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 135/257] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:11 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:12.687460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.688073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:12.694917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.695354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.696145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.696572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.760155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:12.761635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:12.770034 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.770989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.771794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:12.772216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:12.853332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.861482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5ec9f33e-331c-467e-a5e8-3a1ce517bbf8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.177771 Jun 27 21:18:12.862175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 123/258] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:12.962436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.971443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.973266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:12.974810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3ec69f2e-74f0-4b70-b37f-cec7f83d1ac7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1745 microversion: 2.20 time: 0.218792 Jun 27 21:18:12.975550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 136/259] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:12 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1745 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:13.148857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:13.150316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:13.157325 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.158070 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.158863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.159509 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.383352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:13.393085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dd3213a7-f120-4b7a-85fa-1837c711231e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.249121 Jun 27 21:18:13.393817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 124/260] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:13 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:13.886252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:13.887492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:13.896272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.897100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:13.898874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:13.899519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.000022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.000767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.018556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.021738 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.022627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.030140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.201122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.214511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-785c2c48-2b5c-4bd1-9c21-39c391d3a5b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.336240 Jun 27 21:18:14.217942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 137/261] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:13 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:14.410740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:14.411785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:14.413860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:14.414729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:14.430210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.436978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.439598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:14.442000 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:14.551509 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:14.906090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.914052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.915647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.916822 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64bf1082-b33c-4690-834c-cb0405729664 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.923151 Jun 27 21:18:14.917375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 125/262] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:13 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 924 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:14.932926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:14.948769 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b331cfce-60d4-457c-8bdb-449583f36f1a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.542076 Jun 27 21:18:14.970734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 138/263] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:14 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 565 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:15.234085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.247318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.269601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.275014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.279407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.282700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.654616 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:15.664033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c305d411-b358-495e-a7a6-f55dee75c6e1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.435781 Jun 27 21:18:15.667997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 126/264] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:15.944624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.946314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:15.962940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.963651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.964606 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:15.965787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:15.988784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:15.989834 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.005252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.007166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.009632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.012429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.488694 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.501213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0459031f-5a1f-456b-b97a-fcc47c307aed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.518060 Jun 27 21:18:16.502304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 127/265] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:16.588084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.604336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.611657 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:16.614180 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4405fd0e-1908-483c-a872-387a8c40afc0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.682146 Jun 27 21:18:16.617274 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 139/266] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:15 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:16.686430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:16.687053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:16.718425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.718818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.727919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:16.735571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:16.749756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:17.122375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.130402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-52e87c66-cdd1-4916-b22a-df4da778d111 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.449055 Jun 27 21:18:17.131256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 128/267] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:16 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:17.521947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.523206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.535349 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.535892 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.536610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.537038 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.635049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:17.636977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:17.645907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.656384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.657511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:17.658097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:17.905646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.918187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.923636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:17.926761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-aa4803ad-552f-4add-995b-9faadaf428f4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.294944 Jun 27 21:18:17.927874 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 129/268] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:18.026156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.040060 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-963ec746-c2f1-4008-bd91-cc8a57b2788a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.517734 Jun 27 21:18:18.051046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 140/269] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:17 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:18.169190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.170064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.207411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.209252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.210727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.211381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.539077 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:18.552216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-75f4e95b-affe-4e1c-a5ff-444d4bb4f2a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.406565 Jun 27 21:18:18.575218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 130/270] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:18.946016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:18.946668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:18.961540 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.963386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:18.964493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:18.965751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.074317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.075593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.094888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.098798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.101492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.102104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.359154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.372812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-804b5325-b5b5-4147-b853-2a16c8224023 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.308965 Jun 27 21:18:19.374448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 131/271] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:19.380354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-e40cd44c-8418-4f5c-9fa9-b909df0e97cc req-fcc5ceac-e0cf-44ce-b2b2-f645876bba2c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "name": "network-vif-plugged", "status": "completed", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:19.394012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e40cd44c-8418-4f5c-9fa9-b909df0e97cc req-fcc5ceac-e0cf-44ce-b2b2-f645876bba2c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.397058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e40cd44c-8418-4f5c-9fa9-b909df0e97cc req-fcc5ceac-e0cf-44ce-b2b2-f645876bba2c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.425384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-e40cd44c-8418-4f5c-9fa9-b909df0e97cc req-fcc5ceac-e0cf-44ce-b2b2-f645876bba2c service nova] Creating event network-vif-plugged:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:18:19.432018 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-e40cd44c-8418-4f5c-9fa9-b909df0e97cc req-fcc5ceac-e0cf-44ce-b2b2-f645876bba2c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055164 Jun 27 21:18:19.433140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 132/272] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:19.500079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.564281 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.574418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.576611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2f5777ec-329a-4ebb-97b6-458f0a913d89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.634689 Jun 27 21:18:19.578223 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 141/273] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:18 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:19.583893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:19.584775 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:19.595515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.598028 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.598902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:19.599402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:19.934862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:19.946721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fcdc1634-1c99-4a71-8ed5-ed24a885e6dd tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.366780 Jun 27 21:18:19.947828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 133/274] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:19 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:20.392227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.392835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.399562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.400046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.400816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.401273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.597379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.597996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.612521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.614073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.616363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.618394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.783435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.811142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f1d9de56-4d63-4764-888a-be8964d927f8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.422983 Jun 27 21:18:20.825023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 142/275] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:20.971961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:20.973217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:20.985597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:20.996976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.997644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:20.997930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:20.998530 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.001426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.003877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.006587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-229f95b9-9049-4997-a2d1-939e4e19f369 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.414373 Jun 27 21:18:21.020609 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 134/276] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:21.374640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:21.385342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f93a4637-8615-4d8a-8c7c-1a82ac075a34 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.422562 Jun 27 21:18:21.386204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 143/277] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:20 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:21.660120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-181c426a-ddd3-40bb-b604-f9ff44a2f340 req-649b518a-5415-45db-83dd-597316b3aeb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c714031-7635-4b59-bf82-3fa3a17deb64", "name": "network-vif-plugged", "status": "completed", "tag": "e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:21.677939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-181c426a-ddd3-40bb-b604-f9ff44a2f340 req-649b518a-5415-45db-83dd-597316b3aeb7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.678606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-181c426a-ddd3-40bb-b604-f9ff44a2f340 req-649b518a-5415-45db-83dd-597316b3aeb7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.734321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-181c426a-ddd3-40bb-b604-f9ff44a2f340 req-649b518a-5415-45db-83dd-597316b3aeb7 service nova] Creating event network-vif-plugged:e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44 for instance 7c714031-7635-4b59-bf82-3fa3a17deb64 on hv-cinder-84773 Jun 27 21:18:21.745431 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-181c426a-ddd3-40bb-b604-f9ff44a2f340 req-649b518a-5415-45db-83dd-597316b3aeb7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089226 Jun 27 21:18:21.749029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 135/278] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:21.833838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:21.835686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:21.851773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.858970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:21.860644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:21.862338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.046334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.047860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.055235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.060243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.061251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.061923 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.345786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.357566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.367037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.374062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0b82f97a-daad-4b4f-b27e-a698bb4e024e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.339032 Jun 27 21:18:22.375225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 136/279] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:22.404209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:22.404825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:22.411956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.412664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.414500 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:22.415164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:22.580030 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.588062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-abdee411-e4fb-4af7-a5d6-e16ac0e31573 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.188599 Jun 27 21:18:22.598566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 137/280] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:22 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:22.773224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:22.782611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-508298fc-fb01-4b3b-91e4-7fb7d744f18e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.953687 Jun 27 21:18:22.789113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 144/281] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:21 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:23.395737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.396650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.415318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.415847 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.419253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.419960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.614537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.615335 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.625137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.625747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.626632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.627167 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.722688 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.736905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.738800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:23.740436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64f3702b-dcfc-4fe7-b93a-46faef9a9d58 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.351082 Jun 27 21:18:23.752602 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 138/282] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:23.805127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:23.806316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:23.819977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.820543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:23.822378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:23.823508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.021434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.046651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-90c9bd07-fbd4-496d-ac7c-22ba2432f4d2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1367 microversion: 2.1 time: 0.436047 Jun 27 21:18:24.066374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 145/283] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1367 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:24.069881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:24.079515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-da652a03-5156-4e92-87c3-71e02743c7f0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.283643 Jun 27 21:18:24.088886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 139/284] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:23 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:24.758522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:24.759156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:24.780654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.786218 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:24.787236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:24.787871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.082236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.082930 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.093920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.094361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.098143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.098861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.128695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.143403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.145254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.148980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ad9b48d8-5309-4841-8bad-9444d99f08d3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.394413 Jun 27 21:18:25.156450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 146/285] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:24 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:25.161348 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.162101 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.176739 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.177461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.178444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.179031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.522969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.536022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-051cb61e-6a9e-4ce3-aaad-47ccacef02b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1558 microversion: 2.1 time: 0.454553 Jun 27 21:18:25.536642 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 140/286] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1558 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:25.558231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:25.558736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:25.581682 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.582242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.583065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:25.583495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:25.615538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:25.624675 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a4d92f44-caa5-4a7f-989e-a27dcd79cab6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.466883 Jun 27 21:18:25.629636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 147/287] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:25.974528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dbfd85da-d40d-4f96-9b29-cdeb31093c43 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.425807 Jun 27 21:18:25.975686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 141/288] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:18:25 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/os-interface => generated 285 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:26.181877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.183157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.199019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:26.204017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.208160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.209896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.215448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.484783 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.498149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.499717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:26.500903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-29ac15d8-d734-4784-af9f-e270c81ca7d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.330498 Jun 27 21:18:26.501459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 148/289] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:26.648119 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:26.649417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:26.662351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.663127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:26.664155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:26.670850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.520414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:27.522086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:27.534168 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.535020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:27.536162 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:27.538517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:28.102489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.120056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.127127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.129670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c7fd47f4-5883-4f9e-b3f4-f54bdfd533b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.612521 Jun 27 21:18:28.133434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 149/290] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:27 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 617 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:28.893502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:28.915502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-538b3ebf-c01a-4d7e-8267-8e1e8a1db181 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 2.272903 Jun 27 21:18:28.926321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 142/291] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:26 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 2284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:29.152131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:29.152996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:29.169434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.169879 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.177178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.177850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.627548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.657337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.670886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:29.677127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cae8deec-78a0-4574-aa20-75ead0383d7a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.530154 Jun 27 21:18:29.704357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 150/292] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:29 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:29.943264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:29.944844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:29.951574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:29.964286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.965209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:29.966164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:29.967038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.695578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:30.696478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:30.710774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.712570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.713460 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:30.715427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:30.785988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:30.795043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-83dee830-3f96-46f2-9bc6-2af65b8fdf57 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1522 microversion: 2.1 time: 0.856781 Jun 27 21:18:30.799058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 143/293] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:29 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1522 bytes in 862 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:31.051773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.061180 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.068083 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:31.072545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1bbc85ad-0776-427f-b190-57396656623d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.381193 Jun 27 21:18:31.087934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 151/294] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:30 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:31.772304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-a37031fb-a55a-4d8e-bb08-7c138afa6041 req-79754388-c7fb-47c4-8708-73451bebc835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c714031-7635-4b59-bf82-3fa3a17deb64", "tag": "e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:31.793458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-a37031fb-a55a-4d8e-bb08-7c138afa6041 req-79754388-c7fb-47c4-8708-73451bebc835 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.794170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-a37031fb-a55a-4d8e-bb08-7c138afa6041 req-79754388-c7fb-47c4-8708-73451bebc835 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.809109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-a37031fb-a55a-4d8e-bb08-7c138afa6041 req-79754388-c7fb-47c4-8708-73451bebc835 service nova] Creating event network-changed:e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44 for instance 7c714031-7635-4b59-bf82-3fa3a17deb64 on hv-cinder-84773 Jun 27 21:18:31.816885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:31.818036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:31.819368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-a37031fb-a55a-4d8e-bb08-7c138afa6041 req-79754388-c7fb-47c4-8708-73451bebc835 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051135 Jun 27 21:18:31.820010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 144/295] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:31.826814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.828022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.830561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:31.831101 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:31.876484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:32.100878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:32.101955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:32.108768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.109717 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.110661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.111239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.360316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:32.371835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-976b1aba-2de6-4cb5-8f35-7099234f9829 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1502 microversion: 2.1 time: 0.560144 Jun 27 21:18:32.374760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 152/296] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:31 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1502 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:32.394482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:32.395380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:32.408014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.411247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.416102 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:32.416986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:32.853709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:32.865097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2d58d1c7-b218-4ece-b93d-752f307097cc tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1514 microversion: 2.1 time: 0.474149 Jun 27 21:18:32.865711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 153/297] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:32 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1514 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:18:33.107078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.122020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.123782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:33.140405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-63d2b8ec-8d8a-49ce-ba3a-5e549001552c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 1.042114 Jun 27 21:18:33.141033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 145/298] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:32 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 1051 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:34.159600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:34.160482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:34.169794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.170825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.172912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.175633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.548351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.562072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.566205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:34.568496 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2a34959c-d450-4ad1-ac47-5d65360a7b4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.413851 Jun 27 21:18:34.569544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 154/299] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:34 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:34.683468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:34.684634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:34.709468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.709911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.710718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.711198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.756562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'flavor' on Instance uuid 49a3191b-7b8d-45c0-b7a7-a92591a03df0 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:18:34.780407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:34.866101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-42ed2d95-a033-4d1f-99bb-19157174988c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/action" status: 200 len: 32 microversion: 2.1 time: 0.200818 Jun 27 21:18:34.866801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 146/300] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:18:34 2022] POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:18:34.877996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:34.879108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:34.887502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.889691 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:34.892124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:34.893727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.339639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.348813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b8ee37af-c87c-4b85-930a-cc28230516ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.475874 Jun 27 21:18:35.351046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 155/301] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:34 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:35.588432 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:35.589288 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:35.603851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.604516 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.605596 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:35.606228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:35.903050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.923839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.925663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:35.926888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4dd91b59-e5b1-4a76-a1d8-bb7807f5c740 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.343660 Jun 27 21:18:35.927775 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 147/302] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:35 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:36.369277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:36.370477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:36.395726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.397620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.399028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.403785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.947485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:36.949092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:36.964569 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.967564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:36.971095 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:36.972902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:37.380414 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.398143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.400165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:37.402329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-aa573aea-cc03-42a8-9ef1-dec6ca9b8e73 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.459774 Jun 27 21:18:37.403466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 148/303] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:36 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:37.891687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2a98b3c8-3480-4190-bb9a-fe1b18d90a4a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Action: 'create', calling method: .version_select at 0x7eff55bc5a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-367607908", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB/2i+geAUuyDn96uQtJrtCCPrIH0O9e4O/cs5Pow69ldfBgm34P2Ys606AYr0YOWU+lKZRxFO5ADDG3o8o4vbkWJg3fTrndhQ1a6NzgdcCtuUz/74yXf2N6CaOKFM79IQ=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:37.939771 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-2a98b3c8-3480-4190-bb9a-fe1b18d90a4a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:37.945622 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-2a98b3c8-3480-4190-bb9a-fe1b18d90a4a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for user 32b9a1c24fe84019a311b1331ea2c004 and project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:37.997209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2a98b3c8-3480-4190-bb9a-fe1b18d90a4a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.459634 Jun 27 21:18:38.006617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 149/304] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:18:37 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:18:38.268661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.283480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8817410d-c711-4eb8-b3c8-92e87f0a3002 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 1.914395 Jun 27 21:18:38.284170 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 156/305] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:36 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 1921 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:38.421429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:38.422472 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:38.436026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.436640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.439200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:38.440455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:38.721548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.748099 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.750040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:38.751234 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64a5b83e-3788-4102-a92d-7e753caa9d38 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1740 microversion: 2.20 time: 0.334161 Jun 27 21:18:38.759766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 150/306] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:38 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1740 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:39.300350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:39.302256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:39.315624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.316580 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.318502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.319124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.602928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.614002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-588949b1-9e82-4c07-bc9f-7b4fea938830 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.317725 Jun 27 21:18:39.614850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 157/307] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:39 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:39.772734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:39.773931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:39.781000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.781429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.786043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:39.786614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:39.952487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.967371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.968997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:39.970330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6b7077c9-8243-4653-a9d1-7b278d4d0f6e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1722 microversion: 2.20 time: 0.202273 Jun 27 21:18:39.970881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 151/308] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:39 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:40.632038 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:40.632955 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:40.639726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.641011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.642213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:40.655238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:40.771408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ed51fab5-6dac-48a1-ac29-f31f6f660a0d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Action: 'create', calling method: .version_select at 0x7eff55bc5ee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1383446746", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG8n+4w7uQeXq/tuPvMUUmeGsXhOLv48FBh19lJppQqlwIR/XiHlQ4YXO3bLuntsG+VWLaMCqecN92/5LV5m3nE8D9WpN2T5orejjDpj2Bei1FtP1IjRpDULiB74v9VQmA=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:40.793706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-ed51fab5-6dac-48a1-ac29-f31f6f660a0d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Getting quotas for project 17dea7e9f26c4b74a10d5e00a395fbd7. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:18:40.804246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-ed51fab5-6dac-48a1-ac29-f31f6f660a0d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Getting quotas for user 4f9b08c0c7fd4d2e957afcefca500751 and project 17dea7e9f26c4b74a10d5e00a395fbd7. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:18:40.816325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:40.829349 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5751d080-7fd0-488d-b35c-1cc09838a24e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.201426 Jun 27 21:18:40.830222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 158/309] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:40 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:40.849645 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ed51fab5-6dac-48a1-ac29-f31f6f660a0d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.209582 Jun 27 21:18:40.850622 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 152/310] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:18:40 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:18:40.989178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:40.989784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:41.008481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.012426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.013528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.014285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.215138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:41.223845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:41.225504 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:41.227194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-981b3e50-1502-46f7-ae17-ecd47b3d2b1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1722 microversion: 2.20 time: 0.241923 Jun 27 21:18:41.233740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 159/311] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:40 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1722 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:41.846767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:41.847649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:41.857761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.858460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:41.859707 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:41.860444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:42.069792 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.079632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-acee9a14-70f4-4e07-88c1-830d47f90d4f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.237055 Jun 27 21:18:42.080303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 153/312] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:41 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:42.246853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:42.247533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:42.253838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:42.254352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:42.255192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:42.255691 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:42.425051 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.436126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.437955 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:42.439386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-157c8fc5-c53a-484f-b343-6f8f9f5dd090 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1722 microversion: 2.20 time: 0.196961 Jun 27 21:18:42.442727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 160/313] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:42 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:43.096816 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:43.098068 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:43.105263 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.106025 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.107038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.107831 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.270392 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.279972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f4d0e37c-18b4-4894-ae2f-dc8b89f21e76 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.187084 Jun 27 21:18:43.281088 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 154/314] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:43 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:43.463600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:43.464246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:43.480597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.481892 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.482882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.483489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.637948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.646838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.648919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:43.650088 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d02f98a0-c785-4a78-ac13-453cb5e828cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1665 microversion: 2.20 time: 0.193673 Jun 27 21:18:43.651071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 161/315] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:43 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1665 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:43.672303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f2528dfd-1ef0-452a-b8d8-7d328ceae6da"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:43.673411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:43.686691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.687508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:43.688706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:43.689334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.249821 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e7ee86c9-0289-48b9-ac21-7cc1d9f63659 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.580237 Jun 27 21:18:44.253200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 155/316] 10.222.0.27 () {62 vars in 1363 bytes} [Mon Jun 27 21:18:43 2022] POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments => generated 188 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:18:44.269305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-3931d12a-ba0d-4725-90ed-8cd5bfa0e731 req-e7ff0e98-933a-4ff6-87fd-b1c7cfdf7e12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "name": "network-vif-unplugged", "status": "completed", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:44.285474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3931d12a-ba0d-4725-90ed-8cd5bfa0e731 req-e7ff0e98-933a-4ff6-87fd-b1c7cfdf7e12 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.285910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3931d12a-ba0d-4725-90ed-8cd5bfa0e731 req-e7ff0e98-933a-4ff6-87fd-b1c7cfdf7e12 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.298597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:44.300010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:44.306907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.315565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.compute.server_external_events [req-3931d12a-ba0d-4725-90ed-8cd5bfa0e731 req-e7ff0e98-933a-4ff6-87fd-b1c7cfdf7e12 service nova] Unable to find a host for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43. Dropping event network-vif-unplugged {{(pid=117893) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 21:18:44.315892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.316511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-3931d12a-ba0d-4725-90ed-8cd5bfa0e731 req-e7ff0e98-933a-4ff6-87fd-b1c7cfdf7e12 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.055886 Jun 27 21:18:44.320598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 162/317] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:18:44 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 60 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 21:18:44.326650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.327280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.497080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:18:44.498380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:44.506432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.507313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.508414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.509199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.593098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.609256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6d48cacc-ec18-4aac-8c79-2c774bfe1f38 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.314546 Jun 27 21:18:44.609838 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 156/318] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:44 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:44.654390 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-997fe249-646d-4e41-b80d-ed386a2b0801 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/action" status: 202 len: 0 microversion: 2.20 time: 0.177325 Jun 27 21:18:44.655442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 163/319] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 27 21:18:44 2022] POST /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/action => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:18:44.664498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:44.665036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:44.672280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.672950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.673886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:44.674466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:44.922867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.951806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.953936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:44.956261 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-33ea6a17-02b8-44e3-836b-b05ac35b84d9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.296598 Jun 27 21:18:44.957592 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 157/320] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:44 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:45.626490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:45.627119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:45.635176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.635636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:45.636871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.637307 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:45.929143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:45.939091 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-42538138-b515-48f2-ab20-af31a1646f02 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.315936 Jun 27 21:18:45.940421 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 164/321] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:45 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:45.974205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:45.974950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:45.982188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.982865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:45.983659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:45.984249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:46.140047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.148886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.150413 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:46.151589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-598145fd-574e-4472-aea2-192980237ae5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.181289 Jun 27 21:18:46.152176 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 158/322] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:45 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:46.956727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:46.957286 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:46.963550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:46.964021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:46.964770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:46.965196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:47.106490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:47.115462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-95e3ce8d-8ae2-4824-a2c3-957a81387603 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.162567 Jun 27 21:18:47.116086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 165/323] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:46 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:47.170518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:47.171083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:47.178142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:47.178598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:47.179390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:47.179852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:47.324157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:47.333857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:47.335406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:47.336758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c6b1758d-98f5-4d7e-8cdf-c63e72868881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.170259 Jun 27 21:18:47.337317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 159/324] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:47 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:18:48.132761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:48.133337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:48.140050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.140487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.141471 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.141905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.269710 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.277678 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7493f69e-924a-4061-a192-8c13aa8f5898 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.148825 Jun 27 21:18:48.278204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 166/325] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:48 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:48.354845 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:48.355597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:48.362432 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.362800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.363551 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:48.364026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:48.502316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.514158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.515816 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:48.516996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-10578f04-c4c5-4e7c-9f5b-1c4cbbfcfbdc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.166233 Jun 27 21:18:48.517550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 160/326] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:48 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:49.295903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:49.297053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:49.306871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.307519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:49.308488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.309072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:49.454997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:49.464464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9d47e87-0b61-4ee0-a0d1-5b7ee7e47abe tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.173600 Jun 27 21:18:49.465472 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 167/327] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:49 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:49.536569 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:49.537170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:49.543946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.544393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:49.545163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:49.545579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:49.549630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=6,nova_cell1:INSERT=4 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:49.692338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:49.700907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:49.702477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:49.703581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a8e8d941-cc55-4950-bb46-e2dec4c80002 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.171084 Jun 27 21:18:49.704146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 161/328] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:49 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:50.483384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:50.484780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:50.491998 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:50.492425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:50.493385 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:50.493816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:50.637271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.642819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:50.649382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6baf2e9f-7f4c-446b-979b-a8d9ef5e6f3e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.170214 Jun 27 21:18:50.650604 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 168/329] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:50 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:50.721958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:50.722537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:50.729355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:50.729804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:50.730566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:50.730995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:50.825101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=8 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:50.882511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.891936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.893471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:50.894629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-16840cb5-23ff-4bc9-909a-5b0c652a9b2d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.176602 Jun 27 21:18:50.895184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 162/330] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:50 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:51.666171 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:51.666767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:51.674176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.674609 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:51.675350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.675994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:51.817910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:51.835954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-073deb64-3e49-48ba-953c-b42644cbb59d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.173578 Jun 27 21:18:51.837026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 169/331] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:51 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:51.915105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:51.916513 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:51.924380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.925859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:51.926862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:51.927513 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:52.090166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.099460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.100988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:52.102397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-346f7a4f-7c50-4128-90b6-62841adf8bb3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.191816 Jun 27 21:18:52.102977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 163/332] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:51 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:52.854702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:52.854702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:52.860538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:52.860974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:52.861734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:52.862153 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:53.013876 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.021265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86a748e0-e8a9-48b5-bade-e6d23a4b918d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.171721 Jun 27 21:18:53.021976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 170/333] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:52 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:53.123697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:53.124219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:53.133013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:53.133446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:53.134196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:53.134665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:53.265909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.274820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.276367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:53.277525 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cd5c2657-ccad-4fb8-bf1e-39ec4056d782 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.159088 Jun 27 21:18:53.278111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 164/334] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:53 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:54.040845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:54.041427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:54.049015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.049689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.050557 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.051179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.201048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.208850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16d2a7ef-c3f8-427d-8d2d-8721fdd0a1ce tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.172000 Jun 27 21:18:54.209495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 171/335] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:54 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:54.300048 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:54.300588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:54.307495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.307966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.308724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:54.309148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:54.450917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.459714 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.461454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:54.462651 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-818c607f-ec87-497f-aba6-1b2ad0d4d71f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.166696 Jun 27 21:18:54.463250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 165/336] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:54 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:55.226576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:55.227146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:55.233944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.234380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:55.235133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.235540 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:55.379242 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:55.386979 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ce13e996-0264-493b-abb4-25221e5b8c18 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.164292 Jun 27 21:18:55.387535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 172/337] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:55 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:55.482190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:55.482809 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:55.492848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.493306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:55.494112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:55.494761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:55.631135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:55.640456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:55.642125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:55.643497 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-810878d6-18cb-479b-9ea9-85074bbe252e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.165206 Jun 27 21:18:55.644075 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 166/338] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:55 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:56.404461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:56.405013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:56.408085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=52 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:18:56.412478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:56.412910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:56.413665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:56.414085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:56.558810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.567463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-991f1491-2fdd-49a1-bd51-3f4fcb559021 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.166793 Jun 27 21:18:56.579834 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 173/339] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:56 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:56.663086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:56.664333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:56.671017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:56.671457 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:56.672249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:56.672662 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:56.803065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.812928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.814409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:56.815553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5d70cbc1-995b-42de-a93c-293269ff44c6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.156423 Jun 27 21:18:56.816174 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 167/340] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:56 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:57.585378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:57.585932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:57.592197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.592969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:57.593569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.593948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:57.733703 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:57.741275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3b9a2d08-4b51-41b7-878d-8d9d44d3405e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.160315 Jun 27 21:18:57.741871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 174/341] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:57 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:57.834332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:57.835007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:57.845439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.845883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:57.846693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:57.847125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:58.031470 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.044157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.045856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.047089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-106e2238-9283-4d46-8271-ba8988073853 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.217782 Jun 27 21:18:58.047707 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 168/342] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:57 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:58.761499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:58.762109 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:58.769516 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:58.770270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:58.771438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:58.772107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:58.962510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:58.972696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8c368e17-81ea-4b6f-aab6-aa481e0c5cff tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.215011 Jun 27 21:18:58.980899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 175/343] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:58 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:18:59.065891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:59.067191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:18:59.074161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:59.074918 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:59.076052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:18:59.076661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:18:59.240802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.251783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.253810 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:18:59.254982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6fb26e9f-dd31-4d92-9df9-d374ee883920 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.193279 Jun 27 21:18:59.255818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 169/344] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:18:59 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:18:59.993164 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:18:59.995567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:00.002467 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.002905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:00.003692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.004123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:00.148039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:00.156511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b8645211-b7cb-40b6-ace9-2aa713545eb6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.168086 Jun 27 21:19:00.157103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 176/345] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:18:59 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:00.277559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:00.278176 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:00.281477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:00.289063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.289548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:00.290331 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:00.290755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:00.430567 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:00.439511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:00.441101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:00.443063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fcc1bab3-c435-49cf-931c-938be2b435e2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1751 microversion: 2.20 time: 0.171611 Jun 27 21:19:00.443669 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 170/346] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:00 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1751 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:00.622335 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-120376507", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "networks": [{"uuid": "dbf1c1b1-055e-4f33-8c19-ac43d1ef0a1b"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:00.672895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] validate_networks() for [('dbf1c1b1-055e-4f33-8c19-ac43d1ef0a1b', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:01.034577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:01.035204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:01.035421 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:01.035886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:01.036283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:01.045339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.045832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.046602 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.047016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.065449 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Getting quotas for project 7457a8f362994239ad37f279eb57cf0a. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:01.069625 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Getting quotas for user 382e7a3612e348cc96c95dd3be986061 and project 7457a8f362994239ad37f279eb57cf0a. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:01.080847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:01.082985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:01.130812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-376145e2-e18d-4a1c-9ff2-420359f3d799 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.512361 Jun 27 21:19:01.131425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 177/347] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:00 2022] POST /compute/v2.1/servers => generated 380 bytes in 514 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:19:01.141758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-25a018c4-a570-4434-a660-b2b637ffc7fc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:01.142358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-25a018c4-a570-4434-a660-b2b637ffc7fc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:01.174483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:01.175100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:01.189021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.189450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.190238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.190658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.198754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-25a018c4-a570-4434-a660-b2b637ffc7fc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.206387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-25a018c4-a570-4434-a660-b2b637ffc7fc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1218 microversion: 2.1 time: 0.068734 Jun 27 21:19:01.207109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 171/348] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:01 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1218 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:01.331233 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.339327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-90213c47-2f90-4495-b87b-65d6c73e261c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.169521 Jun 27 21:19:01.339925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 178/349] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:01 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:01.461486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:01.462257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:01.469319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.469734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.470521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:01.470976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:01.607599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.616035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.617547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:01.618695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-428c45f8-7b9b-42db-b9d0-34862217c20f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1753 microversion: 2.20 time: 0.161250 Jun 27 21:19:01.619344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 172/350] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:01 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1753 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:02.223477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:02.224102 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:02.230527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.230965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.231763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.232189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.297932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.306875 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b1f0413f-8764-40ca-a504-8949961a3cdc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1214 microversion: 2.1 time: 0.087204 Jun 27 21:19:02.307437 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 179/351] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:02 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:02.356482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:02.357088 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:02.363743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.364186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.364946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.365373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.501654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.513020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1eada485-f20e-414d-90ed-d4c9289d18a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.160037 Jun 27 21:19:02.514655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 173/352] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:02 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:02.637329 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:02.637935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:02.644315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.644753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.645505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:02.645954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:02.806641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.819598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.821273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:02.822497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de0a80c3-1994-44c6-a521-35ab4010a9f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1753 microversion: 2.20 time: 0.189106 Jun 27 21:19:02.823105 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 180/353] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:02 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1753 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:03.329461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:03.330115 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.336108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.336724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.337493 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.337925 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.398569 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:03.406302 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7d8b59ef-fa58-4f71-baec-3e136366ed6a tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1288 microversion: 2.1 time: 0.080693 Jun 27 21:19:03.406886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 174/354] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:03 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:03.531734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:03.532691 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.539123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.539565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.540366 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.540793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.777204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:03.784931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e46b06c3-154d-4158-a81b-63cf6a71291d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1500 microversion: 2.1 time: 0.257403 Jun 27 21:19:03.785512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 181/355] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:03 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1500 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:03.801142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8f734eb0-1f55-401b-9917-d04889f0a6b1"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:03.802281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.809207 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.809643 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.810600 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.811109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.834638 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] HTTP exception thrown: Cannot 'attach_volume' instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 while it is in vm_state rescued Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Request method failure captured: Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/os-volume_attachments HTTP/1.1 Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 74 Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh5nhYV5-mHXqsRIsyeJyvLFShEA7le7yZj20PKtwqTHr_nxsNbILeRfunOZyWnZPPvc_uG7LTvfFTQR1YSmKj6USXUGVHatidMK6Gj-dJGrPYggxA_MKDQFSiurCQKrOiJzgw_ViDjG0qC86YzYOCorVo7gn0W_tmkXfD4Iq5X_c7I Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:19:03.836571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}] Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 92c1e4ea6ab84f94a2215f8c534ca159 Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {"volumeAttachment": {"volumeId": "8f734eb0-1f55-401b-9917-d04889f0a6b1"}} Jun 27 21:19:03.837898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Cannot 'attach_volume' instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 while it is in vm_state rescued Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': '49a3191b-7b8d-45c0-b7a7-a92591a03df0', 'body': {'volumeAttachment': {'volumeId': '8f734eb0-1f55-401b-9917-d04889f0a6b1'}}} Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:03.838689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 while it is in vm_state rescued Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:03.839959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 while it is in vm_state rescued Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Returning 409 to user: Cannot 'attach_volume' instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 while it is in vm_state rescued {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ff3f45df-493e-4ca4-9b3c-333de8868f40 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040866 Jun 27 21:19:03.841078 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 175/356] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:19:03 2022] POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:19:03.847163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:03.847940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.857155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.857968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.858944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.859340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:03.859844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.860036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:03.867682 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.868359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.869334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:03.870048 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:03.963049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ad043748-fa91-4fbc-b186-e057880555c8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/action" status: 202 len: 0 microversion: 2.1 time: 0.119946 Jun 27 21:19:03.964205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 176/357] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:19:03 2022] POST /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:03.983390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:03.984448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:04.002214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.002674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.003468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.003928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.215749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.225980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.227912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.229084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a9cbebf8-a559-4edc-80bb-0d512dfb6724 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.392303 Jun 27 21:19:04.229635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 182/358] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:03 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:04.365530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.376665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-918e6765-9bd8-49a8-ba70-54d1d824a3eb tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.402794 Jun 27 21:19:04.377291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 177/359] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:03 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:04.423356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:04.423980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:04.430323 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.430725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.431473 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:04.432095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:04.604979 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:04.612633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fd8cb1bb-ed76-43bf-aeea-504426f27934 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.193112 Jun 27 21:19:04.613206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 183/360] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:04 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:05.247828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:05.248471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:05.255529 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.256015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.256829 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.257255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.261756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:05.394371 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:05.394979 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:05.401609 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.402052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.402868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.403294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.448668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.458677 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.460246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.461724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a4c30563-c44e-4c02-aa0f-9b5b6904fbc5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.217942 Jun 27 21:19:05.462346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 178/361] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:05 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:05.533923 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-61434e80-109e-4b76-9e21-05b0dc43bbe8 req-4942bb67-0f02-43c3-aa24-ebaee92985de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c566bcaf-9d3a-4fa8-8c75-f059c5f89f94", "tag": "0f860a24-eabf-4b54-9117-21516c666b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:05.556332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-61434e80-109e-4b76-9e21-05b0dc43bbe8 req-4942bb67-0f02-43c3-aa24-ebaee92985de service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.557141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-61434e80-109e-4b76-9e21-05b0dc43bbe8 req-4942bb67-0f02-43c3-aa24-ebaee92985de service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.571851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-61434e80-109e-4b76-9e21-05b0dc43bbe8 req-4942bb67-0f02-43c3-aa24-ebaee92985de service nova] Creating event network-changed:0f860a24-eabf-4b54-9117-21516c666b44 for instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 on hv-cinder-84773 Jun 27 21:19:05.577193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-61434e80-109e-4b76-9e21-05b0dc43bbe8 req-4942bb67-0f02-43c3-aa24-ebaee92985de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050036 Jun 27 21:19:05.578277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 179/362] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:05.590797 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.602022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ddcf9f9-9a89-4eb5-9970-7980261166b8 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.211233 Jun 27 21:19:05.603508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 184/363] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:05 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:05.630538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:05.631404 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:05.638379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.638956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.647872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:05.647872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:05.794710 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1522889219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367607908", "security_groups": [{"name": "tempest-secgroup-smoke-52619586"}], "block_device_mapping_v2": [{"uuid": "b31b3e95-3b6c-435e-a7d7-50337148633f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:05.873064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:05.883303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8c79c60e-78dd-4abd-850b-7a26083c0778 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.256912 Jun 27 21:19:05.899104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 180/364] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:05 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:05.922059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] validate_networks() for [('b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:06.382749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:06.383573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:06.384546 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:06.385222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:06.385910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:06.398878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.399839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.401190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.402047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.425630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:06.429357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for user 32b9a1c24fe84019a311b1331ea2c004 and project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:06.484291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:06.485674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:06.487152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:06.489386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b31b3e95-3b6c-435e-a7d7-50337148633f',volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:06.501283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.501756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.502554 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.503004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.671934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:06.672107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f4867591-be51-4399-aa90-5cf624ae87f0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.878619 Jun 27 21:19:06.673302 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 185/365] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:05 2022] POST /compute/v2.1/servers => generated 404 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:19:06.679244 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:06.680414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:06.683132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:06.685161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:06.686592 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-107215e5-f1dd-47cb-8e24-0a09a216906f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.209200 Jun 27 21:19:06.687903 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 181/366] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:06 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:19:06.697213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f47ea1d9-2021-4c1d-8387-8fac089b301b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:06.698194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f47ea1d9-2021-4c1d-8387-8fac089b301b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:06.715809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.716974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.718528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.719588 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.764397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f47ea1d9-2021-4c1d-8387-8fac089b301b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:06.772252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f47ea1d9-2021-4c1d-8387-8fac089b301b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1094 microversion: 2.1 time: 0.082480 Jun 27 21:19:06.773093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 182/367] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:06 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1094 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:06.911043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:06.911929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:06.922657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.923985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.925169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:06.925951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:06.940395 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:06.944661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:06.952059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-63ce689b-41e4-44aa-8ca4-d5d6a3250797 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.277608 Jun 27 21:19:06.952988 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 186/368] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:06 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:07.123654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.139118 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2817aa92-d68a-4980-b411-7aaa82b2d49e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.241300 Jun 27 21:19:07.155558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 183/369] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:06 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:07.709891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:07.710505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:07.716946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.717387 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:07.718159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.718584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:07.789587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:07.790363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:07.798086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.798659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:07.799584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.800037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:07.867419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.870324 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.875340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dacbf8cd-201a-42e1-acae-34f9f33c92ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.090016 Jun 27 21:19:07.876136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 184/370] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:07 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:07.879894 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.881591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:07.882854 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-553b2d59-9dda-4370-a0c3-d900b942541f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.177288 Jun 27 21:19:07.885248 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 187/371] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:07 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:07.969237 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:07.969878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:07.976218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.976803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:07.977599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:07.978013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.117823 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:08.125682 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fc48d024-940a-4b72-9f68-92e862b8d292 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.160347 Jun 27 21:19:08.126437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 185/372] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:07 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:08.163031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:08.163699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:08.169920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.170355 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.171108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.171533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.256179 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-294553133", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1383446746", "security_groups": [{"name": "tempest-secgroup-smoke-2116577195"}], "networks": [{"uuid": "216ec63e-6fe6-4bc0-a98d-887c970821f7"}], "block_device_mapping_v2": [{"uuid": "696b1194-4f7a-4285-b867-6e1801c462ec", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:08.318601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:08.327301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-87d73c7b-ff4c-405a-947d-97d10d00658b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.168768 Jun 27 21:19:08.328119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 188/373] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:08 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:08.374770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] validate_networks() for [('216ec63e-6fe6-4bc0-a98d-887c970821f7', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:08.765132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:08.765578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:08.766064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:08.766464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:08.766864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:08.776568 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.777002 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.777789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.778233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.797139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Getting quotas for project 17dea7e9f26c4b74a10d5e00a395fbd7. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:08.801469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Getting quotas for user 4f9b08c0c7fd4d2e957afcefca500751 and project 17dea7e9f26c4b74a10d5e00a395fbd7. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:08.867358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:08.869607 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='696b1194-4f7a-4285-b867-6e1801c462ec',volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:08.893135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:08.893740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:08.901527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.901977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.902731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:08.908404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:08.986913 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.008224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56674fa9-e263-4a11-a037-43f881039360 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.119004 Jun 27 21:19:09.008808 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 189/374] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:08 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:09.021560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:09.022222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:09.029689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.030126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.030890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.031316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.043051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f1f18dc9-2f6b-408d-b9bc-2740ab563419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789725 Jun 27 21:19:09.043051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 186/375] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:19:09.052558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b6ed4125-3c21-4897-82e9-8c764c695b2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:09.053476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b6ed4125-3c21-4897-82e9-8c764c695b2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:09.132492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b6ed4125-3c21-4897-82e9-8c764c695b2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.140633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b6ed4125-3c21-4897-82e9-8c764c695b2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1088 microversion: 2.1 time: 0.091682 Jun 27 21:19:09.143814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 187/376] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:09 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1088 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:09.147443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:09.148060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:09.156044 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.157368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.158328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.159099 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.287200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.298944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.315632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.317184 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e3816cae-37d2-4d55-83c2-269b8eb96388 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.307291 Jun 27 21:19:09.317946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 190/377] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:09 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:09.343722 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.344524 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:09.345320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:09.358357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-eac354fd-cede-48b6-a738-e77e22b0e29b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.215600 Jun 27 21:19:09.359368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 188/378] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:09 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:09.365954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.368341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.369298 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:09.370463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:09.526356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:09.536707 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cc198f29-e83e-4708-8bab-29110a3b94b5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.195819 Jun 27 21:19:09.537919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 191/379] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:09 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:10.025625 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.026339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.033005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.033439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.034220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.034638 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.108918 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.117159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-647536f9-f452-4011-922b-739a40eb5ffd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.095319 Jun 27 21:19:10.118113 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 189/380] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:10.157954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.158896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.165652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.166345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.167113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.167538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.234753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.243176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5e3b0f2a-a248-488e-9b14-3c36cd79bf60 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.089063 Jun 27 21:19:10.243769 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 192/381] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:10.337299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.337954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.344693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.345114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.345917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.346342 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.376622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.377592 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.385588 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.386134 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.387004 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.387501 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.504915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.518751 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.520272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.521464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a66a8ff3-d6b3-4340-aa42-a1d8a9f18b17 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.188467 Jun 27 21:19:10.522466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 190/382] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:10.549261 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.554806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:10.555765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:10.558189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a9e057ac-b398-4571-87fa-1c7ca03520ab tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.185832 Jun 27 21:19:10.568462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.568462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.568462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:10.568462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:10.569636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 193/383] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:10.697779 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:10.705886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-98628fd5-1ece-4e2b-9103-30d63a3a03d9 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.155998 Jun 27 21:19:10.710026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 191/384] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:10 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:11.134318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.134957 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.142066 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.142708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.143708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.144321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.206569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.215280 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ca2254fd-4273-4636-8c6c-4e7a5b04c38f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.084827 Jun 27 21:19:11.215885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 194/385] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:11.260747 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.261407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.268082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.268761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.269533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.270374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.334070 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.341859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-89a85a50-bf8e-4a7b-9972-6ce958a07194 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.085689 Jun 27 21:19:11.342421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 192/386] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:11.543326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.543979 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.550495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.550933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.551703 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.552150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.576388 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.577243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.583644 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.584235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.585125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.585618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.707956 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.718519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.721121 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.722447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-418cec96-6b0a-49c2-bc18-53bb2e6ca71c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.185451 Jun 27 21:19:11.723639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 195/387] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:11.728316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:11.728925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:11.736678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.741587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.742030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.742801 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:11.743238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:11.745686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5acc7256-e1dd-46f4-b871-4697128d4c3a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.173117 Jun 27 21:19:11.746262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 193/388] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:11.882430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:11.892471 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-62746d6e-26ac-4a43-a1de-c1a19be02d47 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.167746 Jun 27 21:19:11.893165 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 196/389] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:11 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:12.232337 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.232852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.239496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.239955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.240790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.241222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.310456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.318054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d7e04b4f-8d78-4613-91d5-00cccf6268d9 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.089673 Jun 27 21:19:12.318864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 194/390] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:12.358442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.359065 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.365360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.365833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.366586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.367004 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.429048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.438878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b20ecaa9-3dbd-468a-9c91-a4f5153cd3ee tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.083277 Jun 27 21:19:12.438878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 197/391] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:12.741333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.742067 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.748890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.749450 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.750373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.750820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.763059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.763696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.770217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.770652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.771513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.772081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.911386 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.921636 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.923058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.924269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2f502768-a453-4bbc-bfd7-c083e7c11624 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.187009 Jun 27 21:19:12.925192 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 195/392] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:12.940550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:12.941063 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:12.941201 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:12.948608 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.949327 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.950371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:12.950476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ab3288d7-07db-440c-a365-810d97050fd5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.191385 Jun 27 21:19:12.951219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:12.951344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 198/393] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:13.086587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.094834 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d1b360fb-1074-4d6c-801a-4e1ffb1190fd tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.158043 Jun 27 21:19:13.095409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 196/394] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:12 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:13.334652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:13.335253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:13.341930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.342384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.343150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.343574 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.410363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.418256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8c968361-a922-4a51-b602-4b54bb1287cb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.087564 Jun 27 21:19:13.418825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 199/395] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:13 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:13.454663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:13.455248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:13.462143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.462584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.463351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.463877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.527368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:13.535094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-00d67cdb-ace0-4431-85cb-ee5dbb57a6f1 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.084333 Jun 27 21:19:13.536463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 197/396] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:13 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:13.943131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:13.945186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:13.951423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.951901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.952669 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.953072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.967508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:13.968145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:13.974159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.975868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.976729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:13.977174 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:13.981657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:14.105046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.114415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.116359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.117623 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ab50fac1-cefe-4611-aabc-a1051b38c940 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.178430 Jun 27 21:19:14.127945 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 200/397] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:13 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:14.130075 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.133662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.134384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.138655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fa58b119-d863-413d-8d1f-f3312a18cf0f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.175735 Jun 27 21:19:14.143656 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 198/398] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:13 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:14.143805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.143805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.143805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.143805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.282050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.289921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fd829b6d-ab29-4aa1-a2f7-633019cd6e86 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.160834 Jun 27 21:19:14.290493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 201/399] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:14.396580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.397255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.404212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.404734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.405749 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.406172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.431596 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-db172a4f-63b7-4e7f-aebe-10da5a5f3164 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/ips" status: 200 len: 149 microversion: 2.1 time: 0.038915 Jun 27 21:19:14.437427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 199/400] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/ips => generated 149 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:14.437584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.437584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.442371 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.442737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "228cfdcc-77b7-454d-acb6-76b3aea91a40"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:14.442881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.443594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.444054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.444379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.450757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.451278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.452131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.452756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.519745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.528231 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-955e2455-7822-4f9c-bdae-27d47cd1a5fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.096762 Jun 27 21:19:14.538196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 202/401] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:14.543317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: POST /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/os-volume_attachments HTTP/1.1 Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 74 Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:19:14.545352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {"volumeAttachment": {"volumeId": "228cfdcc-77b7-454d-acb6-76b3aea91a40"}} Jun 27 21:19:14.546908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': '7c714031-7635-4b59-bf82-3fa3a17deb64', 'body': {'volumeAttachment': {'volumeId': '228cfdcc-77b7-454d-acb6-76b3aea91a40'}}} Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:14.547817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:14.549190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 400 to user: Invalid volume: volume 228cfdcc-77b7-454d-acb6-76b3aea91a40 is already attached to instances: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-299c7277-9564-4792-b872-023d04e96df5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108099 Jun 27 21:19:14.550558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 200/402] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:19:14 2022] POST /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:19:14.554460 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.555124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.555892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.556123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.561550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.561963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.563017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.563127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.563216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.563584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.564385 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.564810 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.584403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:14.598715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:19:14.629952 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.639094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9cdb3ee4-78bf-4a1e-9b15-e4d9ad8f578d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.091172 Jun 27 21:19:14.639875 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 203/403] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:14.693723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d4a3e316-adeb-414e-a766-9f294013d5a3 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 204 len: 0 microversion: 2.1 time: 0.141492 Jun 27 21:19:14.694488 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 201/404] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:19:14 2022] DELETE /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 27 21:19:14.703274 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:14.704036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:14.710901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.711427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.712316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:14.712810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:14.845984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:14.854197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c1adc49e-9fa8-4345-8b22-82a69db19f0d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.155290 Jun 27 21:19:14.854734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 204/405] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:14 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:15.139597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.140234 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.146423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.146953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.147752 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.148368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.155403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.156702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.166695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.167358 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.168326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.168912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.290591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.300298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.302475 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.303693 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ad9b45ae-d427-4572-8fd9-3c725f0da3d5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.168893 Jun 27 21:19:15.307661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 202/406] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:15.309359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.309995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.320080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.320444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.321224 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.321688 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.335975 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.352115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e604e25-4831-43d6-8900-1ebb8b638eac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.200366 Jun 27 21:19:15.355306 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 205/407] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:15.458007 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.466163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c6739a82-4574-4e4a-a18f-22d45a27a5ee tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.160110 Jun 27 21:19:15.466360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 203/408] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:15.547763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.548582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.555735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.556201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.557011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.557445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.619023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.626960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1dc9446f-30c9-45da-806e-88f65a2aca34 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.084658 Jun 27 21:19:15.627542 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 206/409] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:15.659275 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.659829 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.668347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.668952 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.669800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.670358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.736290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:15.744193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3c3f8a3e-4a25-49de-a3fd-247474a1316c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.089650 Jun 27 21:19:15.744757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 204/410] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:15.880580 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:15.881493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:15.897338 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.897833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:15.898813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:15.899294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.046933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.054965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eda98344-919b-46e5-abfc-8a6833fe2a08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.181136 Jun 27 21:19:16.055549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 207/411] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:15 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:16.321571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.323814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.328881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.329331 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.330100 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.330533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.369158 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.369735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.371593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:16.377566 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.378010 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.378778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.379205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.417076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:16.436127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=12 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:16.459917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.468716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.470206 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.471368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8bb3a80a-5d31-4d66-a631-a49c36a8c194 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.153795 Jun 27 21:19:16.471951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 205/412] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:16.482779 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.483521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.486689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:16.491585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.492124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.492951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.493442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.509515 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.517729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-96d170a7-76fd-4fff-a098-eb5e8d7d3d00 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.152389 Jun 27 21:19:16.518394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 208/413] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:16.621341 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.629420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ffade6b0-e84c-4f23-beb0-f6fe1d7f2098 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.151129 Jun 27 21:19:16.629988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 206/414] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:16.646762 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.647594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.656603 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.657191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.658242 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.658752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.721683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.729341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-77071971-5074-42ee-b382-dc7ea7643cd4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.088936 Jun 27 21:19:16.729896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 209/415] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:16.760850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:16.761454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:16.768573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.769013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.769777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:16.770205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:16.835588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:16.843220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-83125f88-92ef-4d2e-95ff-098813786e2c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.086284 Jun 27 21:19:16.843808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 207/416] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:16 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:17.078263 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.079121 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.087147 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.087524 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.088313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.088820 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.222977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.230961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ebb8f17-b2a8-4829-80a2-ccc0fc03c08e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.158146 Jun 27 21:19:17.231495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 210/417] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:17.490980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.491584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.497754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.498208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.498961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.499391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.534476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.535048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.542161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.542601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.543365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.544082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.634362 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.643125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.644927 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.646079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5034e096-120c-4eae-8ced-6bdce505b7f0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.159805 Jun 27 21:19:17.646680 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 208/418] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:17.650988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.651580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.657557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.657996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.658747 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.659168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.675350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.683379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e0c4b238-ee11-4e93-b575-be5fee394480 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.152846 Jun 27 21:19:17.683958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 211/419] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:17.745986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.746590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.753497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.753935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.754690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.755150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.788832 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.796409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e62a629b-6f99-486d-8607-6480181eb28e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.148748 Jun 27 21:19:17.796981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 209/420] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:17.816978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.824782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9010120c-938f-432d-8395-0e54c60dedbe tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1144 microversion: 2.1 time: 0.082651 Jun 27 21:19:17.825347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 212/421] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1144 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:17.863453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:17.864498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:17.874306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.875450 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.876391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:17.877098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:17.943678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:17.955324 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0f11bcc6-47b5-4646-b02c-b9389a4e1756 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1138 microversion: 2.1 time: 0.097871 Jun 27 21:19:17.956209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 210/422] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:17 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1138 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:18.252112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.252663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.262020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.262846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.264024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.264593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.398025 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.405682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1a266771-e3dd-4b3b-8f62-74508977207c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.160349 Jun 27 21:19:18.406256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 213/423] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:18.666138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.666742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.672972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.673730 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.674131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.674577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.700010 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.700598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.706642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.707122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.707894 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.708316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.787952 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:18.811835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.824193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.825846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.827088 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ac1fc65f-c5d0-42b3-b918-e5c5f82a5c57 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.165420 Jun 27 21:19:18.827851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 211/424] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:18.835363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.836286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.843155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.843986 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.845022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.845597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.863974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.879426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e1718b21-f850-4af6-9934-187f16faa00e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1508 microversion: 2.1 time: 0.177095 Jun 27 21:19:18.880878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 214/425] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1508 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:18.887017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.892448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.899996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.900474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.901506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.902077 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.964564 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:18.972954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d0852975-6828-4ae6-9d2a-c3e3faed27f1 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1136 microversion: 2.1 time: 0.090826 Jun 27 21:19:18.973656 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 215/426] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1136 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:18.979203 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:18.980111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:18.986560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.986997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.987793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:18.988228 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:18.998610 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:19.006307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9a3dfbf7-01aa-4ca9-b28d-245f6cc2d380 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.177325 Jun 27 21:19:19.006876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 212/427] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:19.059152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:19.070771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-81dc3da1-8b2b-4a5f-a085-b7c6058a3d59 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1130 microversion: 2.1 time: 0.094968 Jun 27 21:19:19.071578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 216/428] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:18 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1130 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:19.427041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:19.428110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:19.430965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=12 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:19.441830 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.442799 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.444033 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.444467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.463557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:19.580380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:19.591868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-27302448-2504-43f3-8d77-de8a060f2a1e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.171198 Jun 27 21:19:19.592591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 213/429] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:19 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:19.849922 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:19.850830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:19.861081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.861816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.863037 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.863777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.897981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:19.898548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:19.905428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.905871 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.906637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:19.907070 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:19.993472 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.002185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.003770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.004924 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3c5c3255-7845-4940-9e6a-3d51919f69b0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.161808 Jun 27 21:19:20.005477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 217/430] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:19 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:20.009835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.010531 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.016515 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.016944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.017700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.018117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.045490 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.053242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e51212e5-9b0a-4605-b76f-925995a0096b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1514 microversion: 2.1 time: 0.159091 Jun 27 21:19:20.053806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 214/431] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:19 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1514 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:20.058283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.058854 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.066085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.066620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.070278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.070278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.081231 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.090311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac836950-116a-45a0-ba22-2c83b1e4609d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1136 microversion: 2.1 time: 0.083759 Jun 27 21:19:20.100213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 218/432] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1136 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:20.100213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.100213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.102688 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.103183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.103970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.104589 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.171681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.179755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-41e606f6-fa4b-4b51-89ee-a928011dd9b3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1130 microversion: 2.1 time: 0.087577 Jun 27 21:19:20.180434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 219/433] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1130 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:20.226463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.235173 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-acfc58c5-e666-42cb-8f35-0f7602338648 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.180400 Jun 27 21:19:20.235856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 215/434] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:20.610095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:20.611399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:20.618832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.619512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.620880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:20.621381 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:20.626617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:20.763827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:20.773871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fa7d0901-d054-42cc-b4f9-7d771ca396bc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.168386 Jun 27 21:19:20.774435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 220/435] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:20 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:21.023383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.024031 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.030949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.031387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.032177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.032606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.106784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.108774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.115674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.116518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.117358 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.117831 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.186890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.195433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-320750fa-5415-4c90-9b90-cb307f37359d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1136 microversion: 2.1 time: 0.092439 Jun 27 21:19:21.205085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 221/436] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1136 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:21.211022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.212057 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.219003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.219361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.220352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.220785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.302330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.312976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c8886af8-77b3-497c-aa14-e4678f70f100 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1186 microversion: 2.1 time: 0.105804 Jun 27 21:19:21.313533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 222/437] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1186 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:21.314723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.324699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.325371 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.325614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.327244 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.328674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-755861b0-0d1c-44a8-909a-e606098bd806 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.309232 Jun 27 21:19:21.329223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 216/438] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:21.332278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.332763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.334314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.334959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.419814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-45b22ba9-2549-4ce6-b125-878372454add tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: .version_select at 0x7eff55b793a0>, body: {"keypair": {"name": "tempest-keypair-288437692", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIqthB2+gZj7QvYWiVD2XJM13ide5rSCAMjaKUl20zP7d1rfQ/WJi7uZcPrvAetDMjOqcpDQmvn/mnnC/q5Exju41UbHabFSuFuSm9wIq5IuAD7ZbVAteE6XBh4ZWFdtA=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:21.434539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-45b22ba9-2549-4ce6-b125-878372454add tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for project 9c06e827e8c44f58a2051705a46e361c. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:21.438581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-45b22ba9-2549-4ce6-b125-878372454add tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for user 92c1e4ea6ab84f94a2215f8c534ca159 and project 9c06e827e8c44f58a2051705a46e361c. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:21.464465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-45b22ba9-2549-4ce6-b125-878372454add tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048702 Jun 27 21:19:21.465562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 217/439] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:19:21 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:21.504816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:21.514423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-86aa6529-31ea-4448-8067-9a92be275262 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.199649 Jun 27 21:19:21.515203 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 223/440] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:21.790524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:21.791126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:21.797615 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.798332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:21.799154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:21.799823 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.009249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:22.020448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8501e45d-d340-431b-9aea-249faf36d947 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1681 microversion: 2.1 time: 0.233940 Jun 27 21:19:22.021034 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 218/441] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:21 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1681 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:22.213026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.213705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.228083 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.233738 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.234642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.235088 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.330260 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.331528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.346363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.348399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.351668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.354938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.458842 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:22.466541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a3d1622a-1de3-41f2-abcc-a76d18380d79 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1200 microversion: 2.1 time: 0.257365 Jun 27 21:19:22.470993 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 224/442] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1200 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:22.488981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.489744 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.496641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.496995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.498011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.498669 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.764301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:22.794399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-529aceea-2e3f-429b-97be-1460b1623ab9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1204 microversion: 2.1 time: 0.465350 Jun 27 21:19:22.803980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 219/443] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1204 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:22.811408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:22.813071 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:22.826574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.827284 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:22.828676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:22.829117 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.112930 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.132144 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-effd1074-f646-4545-be0a-50f3781159eb tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.334411 Jun 27 21:19:23.132732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 220/444] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:23.146994 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-c65ed3da-885b-472f-a95f-df3398f6f54e req-b6de02c7-4876-43c1-aad4-31878946e514 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c714031-7635-4b59-bf82-3fa3a17deb64", "name": "network-vif-deleted", "tag": "e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:23.156132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c65ed3da-885b-472f-a95f-df3398f6f54e req-b6de02c7-4876-43c1-aad4-31878946e514 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.156563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c65ed3da-885b-472f-a95f-df3398f6f54e req-b6de02c7-4876-43c1-aad4-31878946e514 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.183936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-c65ed3da-885b-472f-a95f-df3398f6f54e req-b6de02c7-4876-43c1-aad4-31878946e514 service nova] Creating event network-vif-deleted:e3c8ac03-cfe4-4a9d-9c3c-f2aacf373b44 for instance 7c714031-7635-4b59-bf82-3fa3a17deb64 on hv-cinder-84773 Jun 27 21:19:23.190461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-c65ed3da-885b-472f-a95f-df3398f6f54e req-b6de02c7-4876-43c1-aad4-31878946e514 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056088 Jun 27 21:19:23.194993 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 221/445] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:23.200730 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.201422 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.208093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.209042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.210051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.210546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.250350 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.251010 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.251798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 7c714031-7635-4b59-bf82-3fa3a17deb64 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:23.256243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.273125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.282049 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.283562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-937fb593-ef8d-4ff0-85e7-e3fe14a5f1f6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.811361 Jun 27 21:19:23.287772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 225/446] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:22 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 816 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:23.334156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.345142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4be49427-b03f-425f-9679-ef2c14d37322 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 200 len: 1332 microversion: 2.1 time: 0.148936 Jun 27 21:19:23.346642 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 222/447] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:23 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 1332 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:23.484718 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.485199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.495217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.495679 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.498188 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.498628 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.641888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.652445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b16c9745-b69f-4e85-af01-054e81921fda tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1210 microversion: 2.1 time: 0.172216 Jun 27 21:19:23.653560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 226/448] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:23 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1210 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:23.817224 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:23.818424 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:23.834154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.834154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.834527 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:23.834937 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:23.908766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:23.920254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-13a49e29-5088-4276-b8f3-f7d2d35a2791 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1192 microversion: 2.1 time: 0.107040 Jun 27 21:19:23.921572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 223/449] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:23 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1192 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:24.152210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:24.153044 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:24.166265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.167802 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.171643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.172375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.205108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-664657690", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d0e7ca22-13aa-4b97-b402-60f0a6f6c4a5"}], "security_groups": [{"name": "tempest-securitygroup--630614462"}], "key_name": "tempest-keypair-288437692", "user_data": "}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:24.437184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] validate_networks() for [('d0e7ca22-13aa-4b97-b402-60f0a6f6c4a5', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:24.610080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:24.619098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-77924d94-3c62-4846-a2df-e232cee902be tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.473437 Jun 27 21:19:24.621895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 227/450] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:24 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:24.632016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:24.636125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:24.648040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.649970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.650901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.652452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.941755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:24.942578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:24.944209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:24.944783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:24.945373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:24.958271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.958799 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.961053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:24.961416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:24.983369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:24.987980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Getting quotas for user 92c1e4ea6ab84f94a2215f8c534ca159 and project 9c06e827e8c44f58a2051705a46e361c. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:25.002437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:25.004748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:25.053001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bb181065-0dff-409a-8eb0-d23c7c4fa610 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.852590 Jun 27 21:19:25.053610 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 224/451] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:24 2022] POST /compute/v2.1/servers => generated 408 bytes in 854 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:19:25.062614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.063543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.072523 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.073416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.073767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.074194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.089510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 HTTP/1.1 Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:19:25.091295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:19:25.092819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '7c714031-7635-4b59-bf82-3fa3a17deb64'} Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:25.094725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:19:25.096222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:19:25.097515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:25.097515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0e32e0d1-18d8-4f21-ac4c-398e6ea04da6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 404 len: 111 microversion: 2.1 time: 0.037999 Jun 27 21:19:25.097515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 225/452] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:19:25.097842 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-56d8a65b-09f7-4cc3-9958-f32650f67f46 req-f1abaec0-9c47-40f5-9881-6795645a0f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c566bcaf-9d3a-4fa8-8c75-f059c5f89f94", "name": "network-vif-plugged", "status": "completed", "tag": "0f860a24-eabf-4b54-9117-21516c666b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:25.109452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-56d8a65b-09f7-4cc3-9958-f32650f67f46 req-f1abaec0-9c47-40f5-9881-6795645a0f97 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.109891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-56d8a65b-09f7-4cc3-9958-f32650f67f46 req-f1abaec0-9c47-40f5-9881-6795645a0f97 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.126416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-56d8a65b-09f7-4cc3-9958-f32650f67f46 req-f1abaec0-9c47-40f5-9881-6795645a0f97 service nova] Creating event network-vif-plugged:0f860a24-eabf-4b54-9117-21516c666b44 for instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 on hv-cinder-84773 Jun 27 21:19:25.134538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-56d8a65b-09f7-4cc3-9958-f32650f67f46 req-f1abaec0-9c47-40f5-9881-6795645a0f97 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039695 Jun 27 21:19:25.139957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 226/453] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:25.145567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.145817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.146594 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.154973 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.155540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.155699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.157159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.158341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bc8e7c06-5521-4486-9398-f5135a68d1c3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.535495 Jun 27 21:19:25.159264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 228/454] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:24 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:25.160514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.161015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.164727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.165315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.185414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.186093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.187088 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.187759 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.405806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.442358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-77de1795-8938-4e2f-b1de-696705a76fbb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.300901 Jun 27 21:19:25.444553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 227/455] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:25.449628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0f544fc6-80ec-468e-87d4-19000f81be4d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.450641 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0f544fc6-80ec-468e-87d4-19000f81be4d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.591154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0f544fc6-80ec-468e-87d4-19000f81be4d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.600597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0f544fc6-80ec-468e-87d4-19000f81be4d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1244 microversion: 2.1 time: 0.154700 Jun 27 21:19:25.601621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 228/456] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1244 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:25.610321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e0b1dc71-8711-481d-bbc9-8644a30df435 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '.version_select at 0x7eff55b50b80>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.637094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e0b1dc71-8711-481d-bbc9-8644a30df435 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237033744" status: 202 len: 0 microversion: 2.1 time: 0.030359 Jun 27 21:19:25.638057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 229/457] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 27 21:19:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237033744 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:25.642972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:25.643598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:25.650977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.651429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.652238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:25.652717 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:25.696473 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.706241 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a8ed632-59ae-48e2-b17f-a307f514af38 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.545310 Jun 27 21:19:25.706830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 229/458] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:25.857369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:25.865280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6e913809-2772-486e-a0dd-02fed4447a3e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.226077 Jun 27 21:19:25.866235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 230/459] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:25 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:26.177278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.178044 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.189364 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.189772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.190506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.190955 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.460889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.461523 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.467876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.468319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.469299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.469723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.613054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.621376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5e2e4908-e38f-45ed-a479-050aefd7120d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.164378 Jun 27 21:19:26.622062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 231/460] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:26.626854 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.627458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.634046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.634497 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.635301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.635777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.699310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.707091 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1eafe8ea-9b31-48d8-911a-5f9caebf7221 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1240 microversion: 2.1 time: 0.084026 Jun 27 21:19:26.707802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 232/461] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1240 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:26.724445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.725058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.731942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.732373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.733139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.733558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.870933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.879050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-484673ce-8469-4f59-80bc-12b0e23c28b7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.158566 Jun 27 21:19:26.879638 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 233/462] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:26.884250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:26.884871 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:26.891108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.891517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.892321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:26.892758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:26.908828 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.918149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.919784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:26.921252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9acdbe1-6e71-47be-b0d8-f3fe4312b881 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.748119 Jun 27 21:19:26.921874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 230/463] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 750 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:27.027708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:27.035260 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2ea59d38-7ed1-4c51-9ff7-2b20afc0a8ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1318 microversion: 2.1 time: 0.154663 Jun 27 21:19:27.035834 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 234/464] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:26 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:27.231273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:19:27.231455 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:19:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:19:27.261795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-e93ae818-49c5-4e0c-9e48-205b177663bd req-b2db6b43-dfa5-44e0-9bf1-494664f15101 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:27.275314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e93ae818-49c5-4e0c-9e48-205b177663bd req-b2db6b43-dfa5-44e0-9bf1-494664f15101 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.275785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e93ae818-49c5-4e0c-9e48-205b177663bd req-b2db6b43-dfa5-44e0-9bf1-494664f15101 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.288768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-e93ae818-49c5-4e0c-9e48-205b177663bd req-b2db6b43-dfa5-44e0-9bf1-494664f15101 service nova] Creating event network-changed:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:19:27.294763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-e93ae818-49c5-4e0c-9e48-205b177663bd req-b2db6b43-dfa5-44e0-9bf1-494664f15101 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040126 Jun 27 21:19:27.296046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 231/465] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:27.551054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.551880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.560174 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.560959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.561953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.562981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.627267 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:27.639208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.639936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.647941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.648355 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.649117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.649541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.721221 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'services' on Instance uuid 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:27.803420 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:27.811872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b2cc524-5fb7-4815-b9aa-e7677345a962 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.177064 Jun 27 21:19:27.812653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 232/466] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:27.817549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.818254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.825249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.825815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.826740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.827313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.846062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b3600617-68c8-4382-a762-2d9aa12ec3c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments/228cfdcc-77b7-454d-acb6-76b3aea91a40" status: 202 len: 0 microversion: 2.1 time: 0.300083 Jun 27 21:19:27.846653 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 235/467] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:19:27 2022] DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments/228cfdcc-77b7-454d-acb6-76b3aea91a40 => generated 0 bytes in 302 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:27.855109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.856199 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.862966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.863405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.864195 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.864652 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.889460 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:27.897065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-26e55069-deee-4fa1-90b6-4b13ab1d14c6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 Jun 27 21:19:27.899555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3f6a063b-06b5-434c-aaf0-e2403c5fe344 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1296 microversion: 2.1 time: 0.085571 Jun 27 21:19:27.900021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 233/468] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1296 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:27.901008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 236/469] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:27.904584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.905172 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.911017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.911667 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.912256 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.912676 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.939203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:27.939922 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:27.946110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.946544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:27.947293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:27.947736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.057015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.064830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16a5ce2b-95f8-47b3-9b09-5d95f44075fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.163829 Jun 27 21:19:28.065397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 234/470] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:28.077364 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.077941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.083955 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.084450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.085204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.085622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.087022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.095542 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.097137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.098359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e933a60a-69d2-4ee4-ada1-e89cd13c1df4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.162968 Jun 27 21:19:28.099028 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 237/471] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:27 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:19:28.249752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.257634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-889f3151-cf6a-4198-a85e-b625caba2bd7 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1506 microversion: 2.1 time: 0.183995 Jun 27 21:19:28.258178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 235/472] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:28.832323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.833097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.840008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.840446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.841200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.841623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.908619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.911074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.915811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.916243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.917002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.917440 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.947573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0d1643cc-e413-474d-a079-f32b950e18c1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042906 Jun 27 21:19:28.952102 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 236/473] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:28.957501 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:28.958099 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:28.964969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.965417 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.966170 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:28.966593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:28.981862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:28.986325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:29.001271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-08511654-0896-4b9f-a2a7-9aae39b2e2f5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.174820 Jun 27 21:19:29.002349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 238/474] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:29.086489 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:29.087461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:29.106446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.107886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.108744 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.109182 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.113462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.122308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-70f27216-7aa7-46cc-86fa-ff9e860da2da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1304 microversion: 2.1 time: 0.169118 Jun 27 21:19:29.122889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 237/475] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:28 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1304 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:29.140306 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:29.141183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:29.147549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.148245 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.149173 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.149598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.329154 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.336872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-702640cb-1496-4f87-9e36-61dce55df15e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.259164 Jun 27 21:19:29.337437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 239/476] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:29 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:29.341777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-4b9b0dc2-0ba0-432d-af7e-982e857ac5aa req-c3dde92f-e75c-427f-b252-971e8c0c10b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f989e41d-0c15-4c0b-b96b-4286820a9b48", "tag": "d1b2f6c6-acc1-474f-a4a1-618f87168c62"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:29.346575 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=4,nova_api:DELETE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:29.353813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-4b9b0dc2-0ba0-432d-af7e-982e857ac5aa req-c3dde92f-e75c-427f-b252-971e8c0c10b8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.354241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-4b9b0dc2-0ba0-432d-af7e-982e857ac5aa req-c3dde92f-e75c-427f-b252-971e8c0c10b8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.369020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-4b9b0dc2-0ba0-432d-af7e-982e857ac5aa req-c3dde92f-e75c-427f-b252-971e8c0c10b8 service nova] Creating event network-changed:d1b2f6c6-acc1-474f-a4a1-618f87168c62 for instance f989e41d-0c15-4c0b-b96b-4286820a9b48 on hv-cinder-84773 Jun 27 21:19:29.370056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.374362 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-4b9b0dc2-0ba0-432d-af7e-982e857ac5aa req-c3dde92f-e75c-427f-b252-971e8c0c10b8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jun 27 21:19:29.375374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 240/477] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:29.383249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.384333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:29.385705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-48d00344-1605-4e37-9cb7-38f9c257c77f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.261912 Jun 27 21:19:29.386249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 238/478] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:29 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:29.961343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:29.963391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:29.971550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.972138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:29.973198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:29.974242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.019469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-98eae5d7-42ac-401d-b48d-6098fc5be1d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.063376 Jun 27 21:19:30.020053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.020526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 241/479] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:19:29 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:19:30.020637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.028096 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.028790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.029736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.030264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.079696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.080228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.087126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.087655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.088513 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.089304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.122518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:19:30.241124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-775651dc-1dda-4cc0-a9cc-9a207fdbb27e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 204 len: 0 microversion: 2.1 time: 0.164968 Jun 27 21:19:30.243671 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 242/480] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:19:30 2022] DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 0 bytes in 168 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:19:30.253113 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.254230 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.263416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.264235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.265621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.266428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.355027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.367251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cfb94c14-6211-4ec3-a9a1-0308d500e591 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.351393 Jun 27 21:19:30.368193 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 239/481] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.374199 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.375073 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.383192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.384426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.386285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.388232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.557643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.558746 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.565524 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2ef101d8-2cc5-43bf-aba5-87c351e53ded tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1684 microversion: 2.1 time: 0.195829 Jun 27 21:19:30.566094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 240/482] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1684 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.568303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a391935e-29ec-4b4d-9e4f-bc4915f6f17b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.322617 Jun 27 21:19:30.569155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 243/483] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.571530 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.572149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.578442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:30.578967 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.579404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.580270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.580410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:30.580688 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.587390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.587976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.588819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:30.589345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:30.726539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.735454 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7c85ef65-60ba-4e0a-944f-99457246a675 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.167413 Jun 27 21:19:30.736463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 241/484] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:30.821721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.851896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.851896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:30.852293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-58f3665e-ae71-4a2d-922d-731062c73ed8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.281805 Jun 27 21:19:30.852685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 244/485] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:30 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:31.080002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-df1bc5fd-9e30-4dbd-8f43-4c2ae2f91d5e req-35650245-5ea0-4f41-b031-10d269e823de service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:31.088201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-df1bc5fd-9e30-4dbd-8f43-4c2ae2f91d5e req-35650245-5ea0-4f41-b031-10d269e823de service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.088637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-df1bc5fd-9e30-4dbd-8f43-4c2ae2f91d5e req-35650245-5ea0-4f41-b031-10d269e823de service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.105152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-df1bc5fd-9e30-4dbd-8f43-4c2ae2f91d5e req-35650245-5ea0-4f41-b031-10d269e823de service nova] Creating event network-changed:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:19:31.110240 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-df1bc5fd-9e30-4dbd-8f43-4c2ae2f91d5e req-35650245-5ea0-4f41-b031-10d269e823de service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034169 Jun 27 21:19:31.111044 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 242/486] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:31.385008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.385600 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.392804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.393240 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.393989 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.394409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.537958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.545486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-649f7c14-4d86-471d-b408-5cc3ab515627 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.164510 Jun 27 21:19:31.546047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 245/487] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:31.585250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.585785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.585896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.586506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.592684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.592971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.593131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.593536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.593914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.594339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.594531 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.594954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.734400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.738339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.742273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-795af8aa-8315-4b93-9a0a-2e7b79092cff tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1684 microversion: 2.1 time: 0.160854 Jun 27 21:19:31.742847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 243/488] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1684 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:31.745780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3c05aeea-5a48-4275-8ceb-55cb7fc9fa81 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.164557 Jun 27 21:19:31.746645 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 246/489] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:31.752077 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.752683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.758928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.759352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.760144 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.760582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.872578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:31.873473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:31.881855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.882692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.884233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:31.884890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:31.922835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:31.933392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-03a1b197-7211-4e3a-a3c1-eb1336b5a18d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.184773 Jun 27 21:19:31.933978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 244/490] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:32.040017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.053654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.056997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.059832 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3cd6bcb0-8b16-427c-bc01-bb91764457e5 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.192356 Jun 27 21:19:32.060771 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 247/491] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:31 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:32.400999 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-22dc5c40-a9db-4e9d-8f4e-787dedcc4cf4 req-5d9dd960-c055-430e-bbf0-ceb5f1f8d870 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "name": "network-vif-plugged", "status": "completed", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:32.410103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-22dc5c40-a9db-4e9d-8f4e-787dedcc4cf4 req-5d9dd960-c055-430e-bbf0-ceb5f1f8d870 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.410511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-22dc5c40-a9db-4e9d-8f4e-787dedcc4cf4 req-5d9dd960-c055-430e-bbf0-ceb5f1f8d870 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.425887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-22dc5c40-a9db-4e9d-8f4e-787dedcc4cf4 req-5d9dd960-c055-430e-bbf0-ceb5f1f8d870 service nova] Creating event network-vif-plugged:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:19:32.434069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-22dc5c40-a9db-4e9d-8f4e-787dedcc4cf4 req-5d9dd960-c055-430e-bbf0-ceb5f1f8d870 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036734 Jun 27 21:19:32.435321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 245/492] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:32.568454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.569084 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.576212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.576660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.577461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.577894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.757009 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.761063 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.761772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.764972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fd58d2c3-737f-4f21-a2ea-686a448e61fc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.204087 Jun 27 21:19:32.773824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 248/493] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:32.773824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.773824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.776406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.776844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.777090 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.777605 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.777842 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.778051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.787208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.787208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.916909 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.922167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:32.924563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fbedde0f-44b4-4213-bfae-53698f5a84b8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1684 microversion: 2.1 time: 0.168063 Jun 27 21:19:32.925136 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 246/494] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1684 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:32.930870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-46d223a9-0c1c-4bee-bce9-d100d334cd95 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.164409 Jun 27 21:19:32.931465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 249/495] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:32.950390 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:32.951050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:32.957684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.958273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:32.959047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:32.959631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.080650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:33.081358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:33.087879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.088422 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.089334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.089762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.097275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.105137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c4fb5025-40a8-4f7d-9bc7-5ade2fdb6662 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.158955 Jun 27 21:19:33.105700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 247/496] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:32 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:33.107870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:33.227533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.236784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.238317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:33.239623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-061f53bd-4ada-47cc-b892-78b47e150991 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.162742 Jun 27 21:19:33.240179 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 250/497] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:33 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:33.783538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:33.784187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:33.793598 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.795380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.796521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.797221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.943191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:33.943808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:33.950969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.951407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:33.952204 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:33.952637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.084636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.092319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2e82ec5d-af6e-4ae0-a051-4c758125997e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.313426 Jun 27 21:19:34.096320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 248/498] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:33 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:34.105407 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:34.106342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:34.113125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.113477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.114537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.114960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.227124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.235367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2d9ab4ff-5553-4a2b-a0da-5265342a9999 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1684 microversion: 2.1 time: 0.296687 Jun 27 21:19:34.236793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 251/499] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:33 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1684 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:34.242145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:34.249733 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:34.258808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.259477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.260415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.261053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.267904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.276097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f3ecf829-871d-4f5e-8bde-69512fbe34c4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.178395 Jun 27 21:19:34.276980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 249/500] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:34 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:34.281632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:34.282229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:34.288291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.288734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.289507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.289935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.447764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.456245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9bbe2bf8-8f6e-40b3-a01e-e085ca574bed tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.217988 Jun 27 21:19:34.457391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 252/501] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:34 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:34.721469 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.730213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.732220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:34.734339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-92d86d1d-7510-4478-b290-71bbf7ed82c4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.455605 Jun 27 21:19:34.734339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 250/502] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:34 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:34.791005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-1e08d798-4142-4f9a-a520-d29dcc17a50a req-492da739-ca6f-4b64-8200-6b110e3dbee9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad", "name": "network-vif-deleted", "tag": "5def6202-f28e-4912-b70a-7bf64f620889"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:34.800383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-1e08d798-4142-4f9a-a520-d29dcc17a50a req-492da739-ca6f-4b64-8200-6b110e3dbee9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:34.800820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-1e08d798-4142-4f9a-a520-d29dcc17a50a req-492da739-ca6f-4b64-8200-6b110e3dbee9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:34.812778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-1e08d798-4142-4f9a-a520-d29dcc17a50a req-492da739-ca6f-4b64-8200-6b110e3dbee9 service nova] Creating event network-vif-deleted:5def6202-f28e-4912-b70a-7bf64f620889 for instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad on hv-cinder-84773 Jun 27 21:19:34.818061 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-1e08d798-4142-4f9a-a520-d29dcc17a50a req-492da739-ca6f-4b64-8200-6b110e3dbee9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030779 Jun 27 21:19:34.818659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 253/503] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:35.118477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.119166 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.125196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.126002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.126824 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.127459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.251576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:35.256520 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.257440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.265681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.266378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.267210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.267871 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.289681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.297308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6ff28fec-8d48-422c-b418-c6f6629b7355 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.187971 Jun 27 21:19:35.306727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 251/504] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.306926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.306926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.306926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:35.307197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.307197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.310193 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.310829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.311776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.312226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.355306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.363026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-455d751c-9613-426e-abb8-1a85d7daa658 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1332 microversion: 2.1 time: 0.112810 Jun 27 21:19:35.366863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 254/505] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1332 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.474997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.476000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.483373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.484068 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.487731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.488189 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.522137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.530769 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26b533a9-7242-436f-b1bb-dcdf320a84ba tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.230964 Jun 27 21:19:35.531561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 252/506] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:35.596188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=12 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:35.665766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.676375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2c2f0f96-d7ee-439e-a33a-7052ed7008ba tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.205594 Jun 27 21:19:35.685964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 255/507] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:35.756850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:35.757444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:35.764327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.764763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.765535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:35.765959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:35.925817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.934807 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.936409 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:35.937558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6110701c-f156-4d96-9c20-30ad8d8a012d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.184766 Jun 27 21:19:35.938107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 253/508] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:35 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:36.316623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.317285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.323950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.324397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.325158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.325591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.380709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.382293 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.390053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.390523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.391321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.392476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.426408 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.427106 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.427561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:36.477336 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.477861 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.485603 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9928df24-baba-44b4-ac0c-d902436aadea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.174732 Jun 27 21:19:36.486177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 256/509] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.490462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-26fb7572-8055-40e6-9feb-8369075e6c16 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1332 microversion: 2.1 time: 0.113702 Jun 27 21:19:36.491194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 254/510] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:36.549598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.550370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.559494 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.560086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.561308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.561971 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.692811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.693416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.699891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.700359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.701106 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.701262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.701492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.705814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:36.709228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-400188aa-2f91-4b23-8cf2-152b8a62f312 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.164389 Jun 27 21:19:36.709773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 257/511] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.850772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:36.858505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2a6e62c-bbbc-41ed-8b16-76461f1e5395 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.169833 Jun 27 21:19:36.859081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 255/512] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:36.959762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:36.960425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:36.968255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.968801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:36.969775 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:36.970239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.120015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.128820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.130414 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.131561 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-957c32cf-e45e-4e36-b6ca-e8d126e528eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1809 microversion: 2.20 time: 0.178135 Jun 27 21:19:37.132360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 258/513] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:36 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:37.505319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.506099 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.508965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.509815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.515262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.515928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.517002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.517597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.519292 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.519974 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.521023 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.521447 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.560938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.561371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.561810 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:19:37.602628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.610328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-687b5f41-af03-4c17-b912-8e103b5f7f77 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 200 len: 1332 microversion: 2.1 time: 0.107220 Jun 27 21:19:37.610894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 259/514] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 1332 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:37.655511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.665583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8a28addc-b703-4fc5-8427-2910dcd21894 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.165862 Jun 27 21:19:37.666169 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 256/515] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:37.728035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.728712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.735965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.736459 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.737304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.737785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.874949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:37.875664 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:37.877581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:37.879505 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:37.885183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.885183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.885835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:37.886380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:37.896789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bcde89ee-c84c-4b9b-951c-bff7aebb19f9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.173363 Jun 27 21:19:37.897377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 260/516] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:38.040093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.047915 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fa0a6e18-0176-47c9-9f9c-67a375ea7be2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.176878 Jun 27 21:19:38.048816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 257/517] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:37 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:38.149960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:38.150470 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:38.157190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.157634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.158395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.158822 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.308138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.316802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.318304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.319455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-40c18f12-f9b8-44d3-87dc-4a8896d6fd4c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1796 microversion: 2.20 time: 0.173579 Jun 27 21:19:38.320035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 261/518] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:19:38 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1796 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:19:38.626346 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:38.627663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:38.635427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.636494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.637571 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.637995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.652925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad HTTP/1.1 Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:19:38.654586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:19:38.656157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad'} Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:19:38.657089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:19:38.658908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:19:38.660791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:19:38.660791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9f8aafc-51c9-49be-a3de-62ddd71f17a1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 404 len: 111 microversion: 2.1 time: 0.033510 Jun 27 21:19:38.660791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 258/519] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:38 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:19:38.665666 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1c8d3272-c2a7-40a9-b5f6-5e227c8a0c1b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '.version_select at 0x7eff55aa9940>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:38.682819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:38.683423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:38.685425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1c8d3272-c2a7-40a9-b5f6-5e227c8a0c1b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616390398" status: 202 len: 0 microversion: 2.1 time: 0.023727 Jun 27 21:19:38.686840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 262/520] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 27 21:19:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1616390398 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:19:38.698391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.699827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.704498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.705032 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.727706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-7b27a917-0cf8-4151-bd07-ca3a7c230556 req-109b154e-1f5e-4721-9f6a-44c198a57ceb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "name": "network-vif-plugged", "status": "completed", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:38.741400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-7b27a917-0cf8-4151-bd07-ca3a7c230556 req-109b154e-1f5e-4721-9f6a-44c198a57ceb service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.742668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-7b27a917-0cf8-4151-bd07-ca3a7c230556 req-109b154e-1f5e-4721-9f6a-44c198a57ceb service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.757413 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-7b27a917-0cf8-4151-bd07-ca3a7c230556 req-109b154e-1f5e-4721-9f6a-44c198a57ceb service nova] Creating event network-vif-plugged:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:19:38.762805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-7b27a917-0cf8-4151-bd07-ca3a7c230556 req-109b154e-1f5e-4721-9f6a-44c198a57ceb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039815 Jun 27 21:19:38.763567 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 263/521] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:38.903899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:38.914278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:38.914980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-db5ac262-e4b2-4215-a342-559f64c8d99a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.236368 Jun 27 21:19:38.915358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:38.915854 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 259/522] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:38 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:38.923996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.924504 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:38.925367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:38.925790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.065318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:39.065864 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:39.072704 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.073229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.074095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.074914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.181782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:39.191690 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e5e3195e-f2b4-4fdd-9963-0ffb72accfa6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.281379 Jun 27 21:19:39.200163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 264/523] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:38 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:39.274857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:39.283755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-38392725-5b80-45eb-bfbe-caf7b1b4c233 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.222596 Jun 27 21:19:39.284880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 260/524] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:39 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:39.557361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-82160943-2193-4d89-8d5c-0aaaa6ed85af tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: .version_select at 0x7eff55aa98b0>, body: {"keypair": {"name": "tempest-keypair-19496601", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBDt999/KQyh0979cS0ZTxP3EVXSAO6Iu0K8gPqdmLNRO3xCTjvL23piweizYPB7ufOwuyNzmOdvK1cPpt0IeNkVBgl/JXZTf8dPCVM0U8tBl+TAu4UkWwnXwRs2sDsSAw=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:39.575143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-82160943-2193-4d89-8d5c-0aaaa6ed85af tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:39.579325 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-82160943-2193-4d89-8d5c-0aaaa6ed85af tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:39.604770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-82160943-2193-4d89-8d5c-0aaaa6ed85af tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.053346 Jun 27 21:19:39.605350 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 265/525] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:19:39 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:39.932683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:39.933288 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:39.939586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.940058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:39.940808 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:39.941361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.111674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:40.119337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-628aca8b-f52b-4788-91e1-d306c290773c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.190649 Jun 27 21:19:40.119933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 261/526] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:39 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:40.209604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:40.210225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:40.216972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.217490 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.218323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.218753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.300411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:40.301136 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:40.308201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.308766 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.309534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.309966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.454728 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:40.462523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-39ed8b29-f491-44a5-88fd-9a421d1fde39 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1260 microversion: 2.1 time: 0.166005 Jun 27 21:19:40.464225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 262/527] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:40 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:40.644349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:40.654443 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2ce54126-258e-4721-8d5f-53e69fbab9ec tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.449379 Jun 27 21:19:40.664734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 266/528] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:40 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:40.804070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-680601ee-b208-442a-92d8-8aab7ed012b5 req-0f1a8486-4427-4d8a-834f-3c4c873298d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f989e41d-0c15-4c0b-b96b-4286820a9b48", "name": "network-vif-plugged", "status": "completed", "tag": "d1b2f6c6-acc1-474f-a4a1-618f87168c62"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:40.816032 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-680601ee-b208-442a-92d8-8aab7ed012b5 req-0f1a8486-4427-4d8a-834f-3c4c873298d5 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:40.817508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-680601ee-b208-442a-92d8-8aab7ed012b5 req-0f1a8486-4427-4d8a-834f-3c4c873298d5 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:40.832378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-680601ee-b208-442a-92d8-8aab7ed012b5 req-0f1a8486-4427-4d8a-834f-3c4c873298d5 service nova] Creating event network-vif-plugged:d1b2f6c6-acc1-474f-a4a1-618f87168c62 for instance f989e41d-0c15-4c0b-b96b-4286820a9b48 on hv-cinder-84773 Jun 27 21:19:40.839095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-680601ee-b208-442a-92d8-8aab7ed012b5 req-0f1a8486-4427-4d8a-834f-3c4c873298d5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039924 Jun 27 21:19:40.839717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 263/529] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:41.136368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.137269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.143543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.144024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.144790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.145254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.317133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:41.326537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-306cc6af-80e9-4e57-a17d-b9be62d22021 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.193852 Jun 27 21:19:41.328124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 267/530] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:41.406280 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-403369905", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496540cf-a3b9-4c39-b571-4063a80b6b12"}], "security_groups": [{"name": "tempest-securitygroup--298927820"}], "key_name": "tempest-keypair-19496601", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:41.479363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.479924 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.489181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.489626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.490447 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.490884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.527798 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] validate_networks() for [('496540cf-a3b9-4c39-b571-4063a80b6b12', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:19:41.644672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:41.653202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9c9dad94-7f2a-47e8-8982-51ad5cf39148 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1445 microversion: 2.1 time: 0.177662 Jun 27 21:19:41.653925 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 268/531] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1445 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:41.669641 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.670269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.676381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.677793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.678560 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.679013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.813895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:41.817624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:41.822397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-406d95ab-8ffc-47ab-876e-8eff1067f928 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1445 microversion: 2.1 time: 0.156537 Jun 27 21:19:41.822967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 269/532] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1445 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:41.827715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:41.828297 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:41.834363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.834803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.835933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.836100 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.968386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:19:41.968795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:19:41.969283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:19:41.969728 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:19:41.970120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:19:41.984809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.985236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:41.986014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:41.986432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.004095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:19:42.008283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:19:42.019990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:42.020916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:19:42.023394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:19:42.033186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7c007d0b-4a6b-4fc4-80e1-bf20a83da595 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.208603 Jun 27 21:19:42.034205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 270/533] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:41 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:42.073399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a863bcd0-30c5-4f7d-accf-4c16b9783dd2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.672318 Jun 27 21:19:42.074378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 264/534] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:19:41 2022] POST /compute/v2.1/servers => generated 401 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:19:42.084561 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-40027de4-c361-4d5d-a3d3-86ba0f3a6004 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:42.085168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-40027de4-c361-4d5d-a3d3-86ba0f3a6004 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:42.154308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-40027de4-c361-4d5d-a3d3-86ba0f3a6004 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:42.162380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-40027de4-c361-4d5d-a3d3-86ba0f3a6004 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1239 microversion: 2.1 time: 0.081865 Jun 27 21:19:42.172179 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 271/535] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:42 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:42.344362 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:42.345380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:42.351978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.352723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.354207 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.354792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.570884 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:42.579397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e6c6c813-90bc-4974-be40-bf0e788ee9a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1264 microversion: 2.1 time: 0.239978 Jun 27 21:19:42.580254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 265/536] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:42 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1264 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:42.857903 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-aa843730-767d-4156-9e3b-66f7e9d36974 req-403e6f6e-0393-4bbe-a913-4c2c17b4e67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "name": "network-vif-plugged", "status": "completed", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:42.867915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-aa843730-767d-4156-9e3b-66f7e9d36974 req-403e6f6e-0393-4bbe-a913-4c2c17b4e67f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:42.868357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-aa843730-767d-4156-9e3b-66f7e9d36974 req-403e6f6e-0393-4bbe-a913-4c2c17b4e67f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:42.878705 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-aa843730-767d-4156-9e3b-66f7e9d36974 req-403e6f6e-0393-4bbe-a913-4c2c17b4e67f service nova] Creating event network-vif-plugged:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:19:42.883753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-aa843730-767d-4156-9e3b-66f7e9d36974 req-403e6f6e-0393-4bbe-a913-4c2c17b4e67f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030456 Jun 27 21:19:42.884336 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 272/537] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:43.066774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.067750 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.074149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.074646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.075461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.075919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.180617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.181647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.188577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.188981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.190083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.201166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.275743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.283891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-86c2a2c7-5442-4241-a168-d4bae157d995 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1291 microversion: 2.1 time: 0.108164 Jun 27 21:19:43.286492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 273/538] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1291 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:43.331581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.340724 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2d5fa54e-1614-44ca-8628-559b73f6ba88 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.280029 Jun 27 21:19:43.341266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 266/539] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:43.596697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.597393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.603556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.604001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.604754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.605177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.742585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.751011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1d896105-a0e1-4261-af4d-85aa8e00aa55 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1452 microversion: 2.1 time: 0.157918 Jun 27 21:19:43.752300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 274/540] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:43.768108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:43.769886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:43.776251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.776860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.777771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.778346 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.794409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-b684ccd9-60bf-4c4d-92dd-a6b4c5ef4238 req-c00d1530-e083-43e4-97de-21a019b73306 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:43.804668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-b684ccd9-60bf-4c4d-92dd-a6b4c5ef4238 req-c00d1530-e083-43e4-97de-21a019b73306 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:43.805251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-b684ccd9-60bf-4c4d-92dd-a6b4c5ef4238 req-c00d1530-e083-43e4-97de-21a019b73306 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:43.820106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-b684ccd9-60bf-4c4d-92dd-a6b4c5ef4238 req-c00d1530-e083-43e4-97de-21a019b73306 service nova] Creating event network-changed:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:19:43.825221 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-b684ccd9-60bf-4c4d-92dd-a6b4c5ef4238 req-c00d1530-e083-43e4-97de-21a019b73306 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034398 Jun 27 21:19:43.826131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 275/541] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:43.922893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:43.930919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e8a8cb35-a9ef-47ba-8faa-80dc04b5a2c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1452 microversion: 2.1 time: 0.166516 Jun 27 21:19:43.931640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 267/542] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:43 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1452 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:44.302379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:44.304020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:44.313495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.314308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.315305 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.316152 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.361265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:44.362332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:44.372880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.373753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.376487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:44.376913 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:44.447519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:44.456391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a28d57d1-e5ab-4a53-a4fb-def0a7c2bc74 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1291 microversion: 2.1 time: 0.158267 Jun 27 21:19:44.463375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 276/543] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:44 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1291 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:44.648646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:44.656548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9795b39b-23b9-4148-808e-c85b32ae1bb0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.301209 Jun 27 21:19:44.665857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 268/544] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:44 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:45.475682 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:45.476287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:45.483029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.483464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.484256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.484674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.555142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:45.563111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-359013ff-2543-4bb7-abe4-ae69486268b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1297 microversion: 2.1 time: 0.091537 Jun 27 21:19:45.563684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 277/545] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:45 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1297 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:45.673735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:45.674450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:45.681007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.681447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.682374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.682487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fd95bcfd-5011-4df7-a654-5a3cb34fcdf9", "device": "/dev/sdb"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:45.682801 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.684298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:45.689544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:45.691745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.692254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.693274 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:45.693697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:45.851506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:45.863544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9c30727-6058-4a4a-a755-bea8d3229969 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1369 microversion: 2.1 time: 0.193846 Jun 27 21:19:45.864938 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 269/546] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:45 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1369 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:46.050562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7d72b9e9-fc84-4155-9dd1-b6f49409e6ce tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "POST /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.371840 Jun 27 21:19:46.051881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 278/547] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:19:45 2022] POST /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94/os-volume_attachments => generated 194 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:46.377138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-4af93c16-8d70-4a64-9a9a-d7bd034cf5e2 req-c185ed93-938d-44ea-b12f-3026963adc5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f989e41d-0c15-4c0b-b96b-4286820a9b48", "tag": "d1b2f6c6-acc1-474f-a4a1-618f87168c62"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:46.398775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4af93c16-8d70-4a64-9a9a-d7bd034cf5e2 req-c185ed93-938d-44ea-b12f-3026963adc5f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.399214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4af93c16-8d70-4a64-9a9a-d7bd034cf5e2 req-c185ed93-938d-44ea-b12f-3026963adc5f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.421204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-4af93c16-8d70-4a64-9a9a-d7bd034cf5e2 req-c185ed93-938d-44ea-b12f-3026963adc5f service nova] Creating event network-changed:d1b2f6c6-acc1-474f-a4a1-618f87168c62 for instance f989e41d-0c15-4c0b-b96b-4286820a9b48 on hv-cinder-84773 Jun 27 21:19:46.426643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-4af93c16-8d70-4a64-9a9a-d7bd034cf5e2 req-c185ed93-938d-44ea-b12f-3026963adc5f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053266 Jun 27 21:19:46.427242 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 270/548] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:46.580685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:46.581502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:46.588238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.588824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.589588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.590017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.729128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:46.736955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-eafcf469-30b3-47bd-958f-e44cb2d520e4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.161014 Jun 27 21:19:46.737531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 279/549] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:46 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:46.881394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:46.882093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:46.889219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.889658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:46.890422 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:46.890885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.203100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:47.210996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2ecba7e9-c1d8-44ca-84d1-d9cbbf3a7177 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1563 microversion: 2.1 time: 0.334110 Jun 27 21:19:47.222068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 271/550] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:46 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1563 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:47.228271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:47.229022 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:47.236494 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.237062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.238679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.239391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.330004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c862b8e8-3a88-47df-80b0-d845bc3faefa tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.106250 Jun 27 21:19:47.330674 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 280/551] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:19:47 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-interface => generated 285 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:47.754127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:47.754733 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:47.761043 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.761775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:47.762541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:47.762956 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.077522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:48.086319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-20e27ceb-2ac9-4175-8aeb-57e40bb30d8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.336069 Jun 27 21:19:48.088265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 272/552] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:47 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:19:48.442780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-e0008dbd-2d71-49d8-bc72-8be418641b8a req-ec2b28dc-ee97-4081-aefd-fccd18069b4c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:48.453196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e0008dbd-2d71-49d8-bc72-8be418641b8a req-ec2b28dc-ee97-4081-aefd-fccd18069b4c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:48.453633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e0008dbd-2d71-49d8-bc72-8be418641b8a req-ec2b28dc-ee97-4081-aefd-fccd18069b4c service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.467257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-e0008dbd-2d71-49d8-bc72-8be418641b8a req-ec2b28dc-ee97-4081-aefd-fccd18069b4c service nova] Creating event network-changed:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:19:48.471463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-d49b44cc-5686-42eb-89b9-6d2e2d90f01a req-1d8d5d45-ca8f-4a98-b197-af74915abdd7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da3400a-6c47-4649-a431-48cc4c3ec236", "tag": "3518c3e5-4f6e-4550-b82c-5f5fa154670e"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:48.473314 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-e0008dbd-2d71-49d8-bc72-8be418641b8a req-ec2b28dc-ee97-4081-aefd-fccd18069b4c service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034596 Jun 27 21:19:48.474456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 281/553] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:48.499600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d49b44cc-5686-42eb-89b9-6d2e2d90f01a req-1d8d5d45-ca8f-4a98-b197-af74915abdd7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:48.500067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d49b44cc-5686-42eb-89b9-6d2e2d90f01a req-1d8d5d45-ca8f-4a98-b197-af74915abdd7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:48.517902 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-d49b44cc-5686-42eb-89b9-6d2e2d90f01a req-1d8d5d45-ca8f-4a98-b197-af74915abdd7 service nova] Creating event network-changed:3518c3e5-4f6e-4550-b82c-5f5fa154670e for instance 1da3400a-6c47-4649-a431-48cc4c3ec236 on hv-cinder-84773 Jun 27 21:19:48.526309 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-d49b44cc-5686-42eb-89b9-6d2e2d90f01a req-1d8d5d45-ca8f-4a98-b197-af74915abdd7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067308 Jun 27 21:19:48.526930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 273/554] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:19:49.105586 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:49.106358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:49.113898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:49.114476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:49.115352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:49.115913 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:49.268151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:49.277089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-56fa983d-1b97-4c37-8e7f-eaa4954e9cb9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.176200 Jun 27 21:19:49.278000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 282/555] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:49 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:50.298873 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:50.300671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:50.307930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:50.308393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:50.309186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:50.309633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:50.455115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:50.463765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b31631a9-73c2-4c43-b2d4-9418141a0372 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.171863 Jun 27 21:19:50.464307 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 274/556] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:50 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:51.484634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:51.485586 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:51.497080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:51.497803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:51.499035 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:51.499783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:51.635514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:51.643424 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-61ec2ef6-9b4d-4bb2-a0a3-46dacd3bee6f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.165264 Jun 27 21:19:51.643983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 283/557] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:51 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:52.660747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:52.661384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:52.663376 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:52.664060 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:52.670185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:52.670627 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:52.671392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:52.671885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:52.677212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:52.804026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:52.814700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-757b965b-d286-4296-8ef0-7fbf154b5b08 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.157707 Jun 27 21:19:52.815597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 275/558] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:52 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:53.832666 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:53.833308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:53.835346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:19:53.841641 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:53.842082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:53.842878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:53.843315 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:53.976001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:53.983837 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6c8409be-7d1c-4808-9a1c-1f9e3abd3ae9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.155005 Jun 27 21:19:53.984406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 284/559] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:53 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:54.904711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-896ba8da-0842-4dad-b45a-f85f55c722e2 req-b9c7c8d4-a5e3-425b-a3ea-66279649a667 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da3400a-6c47-4649-a431-48cc4c3ec236", "name": "network-vif-plugged", "status": "completed", "tag": "3518c3e5-4f6e-4550-b82c-5f5fa154670e"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:19:54.913237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-896ba8da-0842-4dad-b45a-f85f55c722e2 req-b9c7c8d4-a5e3-425b-a3ea-66279649a667 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:54.913749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-896ba8da-0842-4dad-b45a-f85f55c722e2 req-b9c7c8d4-a5e3-425b-a3ea-66279649a667 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:54.932670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-896ba8da-0842-4dad-b45a-f85f55c722e2 req-b9c7c8d4-a5e3-425b-a3ea-66279649a667 service nova] Creating event network-vif-plugged:3518c3e5-4f6e-4550-b82c-5f5fa154670e for instance 1da3400a-6c47-4649-a431-48cc4c3ec236 on hv-cinder-84773 Jun 27 21:19:54.940474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-896ba8da-0842-4dad-b45a-f85f55c722e2 req-b9c7c8d4-a5e3-425b-a3ea-66279649a667 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039042 Jun 27 21:19:54.941351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 276/560] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:19:55.002114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:55.002838 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:55.009642 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:55.010077 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:55.010847 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:55.011709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:55.149146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:55.157297 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-28744973-cd2e-4999-b1d4-62edef95a180 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.159075 Jun 27 21:19:55.157870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 285/561] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:54 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:56.177661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:56.178439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:56.185054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:56.185491 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:56.186255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:56.186686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:56.314699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:56.322487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-73f3c4b8-67d3-420a-82d6-db1aa12ef7b7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.150938 Jun 27 21:19:56.323051 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 277/562] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:56 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:57.343156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:57.344146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:57.353082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:57.353519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:57.354272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:57.354695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:57.501789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:57.510047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5e0523de-b334-4b2c-b92a-a937ec6c21b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.173421 Jun 27 21:19:57.510612 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 286/563] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:57 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:58.526781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:58.527351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:58.534012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.534452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:58.535202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:58.535646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:58.670606 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:58.678292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c5d51f22-2af7-43e8-b1a7-15e7f8147c06 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.155534 Jun 27 21:19:58.678839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 278/564] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:58 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:19:59.699870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:19:59.700867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:19:59.711727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:59.712481 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:59.713713 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:19:59.714455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:19:59.857241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:19:59.864948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9fb1abe7-fa03-483a-b842-9c4dcfec5f3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.171690 Jun 27 21:19:59.865582 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 287/565] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:19:59 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:00.884847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:00.885434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:00.894985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.895429 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:00.896227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:00.896653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:01.032620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:01.040571 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a8b23ec4-ce7c-47b0-9776-226eba8bd3d9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.162049 Jun 27 21:20:01.041134 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 279/566] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:00 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:02.057281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:02.057878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:02.064761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:02.065198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:02.066020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:02.066436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:02.084510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:02.201524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:02.209663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-06ae50ad-47b6-47b1-8ad4-1468b792d318 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.156156 Jun 27 21:20:02.210448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 288/567] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:02 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:03.231934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:03.232970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:03.241212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:03.241658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:03.242425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:03.242847 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:03.377374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:03.385026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-006b56d7-a122-46c6-852c-5110b2eb76ec tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1364 microversion: 2.1 time: 0.159726 Jun 27 21:20:03.385597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 280/568] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:03 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:04.406113 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:04.407142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:04.418304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.419039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.420340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.421036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.568315 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:04.580715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2273d1c2-f62e-41e7-852d-daa447e3694f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1554 microversion: 2.1 time: 0.180777 Jun 27 21:20:04.581724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 289/569] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:04 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1554 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:04.597469 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:04.597975 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:04.604393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.604836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.605597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:04.606026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:04.686864 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6130e10c-ebef-4e0b-82f6-b783a68e9577 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093311 Jun 27 21:20:04.687469 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 281/570] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:20:04 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:05.883574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-4511d862-eeac-42d4-ba5c-7653c8a13a1f req-4aa0b39e-cdd4-4b59-b056-08d8be67b2fa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1da3400a-6c47-4649-a431-48cc4c3ec236", "tag": "3518c3e5-4f6e-4550-b82c-5f5fa154670e"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:05.892543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-4511d862-eeac-42d4-ba5c-7653c8a13a1f req-4aa0b39e-cdd4-4b59-b056-08d8be67b2fa service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:05.892972 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-4511d862-eeac-42d4-ba5c-7653c8a13a1f req-4aa0b39e-cdd4-4b59-b056-08d8be67b2fa service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:05.904309 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-4511d862-eeac-42d4-ba5c-7653c8a13a1f req-4aa0b39e-cdd4-4b59-b056-08d8be67b2fa service nova] Creating event network-changed:3518c3e5-4f6e-4550-b82c-5f5fa154670e for instance 1da3400a-6c47-4649-a431-48cc4c3ec236 on hv-cinder-84773 Jun 27 21:20:05.909370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-4511d862-eeac-42d4-ba5c-7653c8a13a1f req-4aa0b39e-cdd4-4b59-b056-08d8be67b2fa service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029464 Jun 27 21:20:05.909966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 290/571] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:10.892337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:10.892836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:10.894787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:10.900395 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:10.900827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:10.901616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:10.902095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:11.027581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lazy-loading 'services' on Instance uuid c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:11.149818 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e00d3c68-21e1-421e-ad91-d444a80fe7a4 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94/os-volume_attachments/fd95bcfd-5011-4df7-a654-5a3cb34fcdf9" status: 202 len: 0 microversion: 2.1 time: 0.261307 Jun 27 21:20:11.150585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 282/572] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:20:10 2022] DELETE /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94/os-volume_attachments/fd95bcfd-5011-4df7-a654-5a3cb34fcdf9 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:20:13.338944 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:13.339977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:13.349602 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.350266 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.351442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.352102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.386778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:13.468839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9fec07ce-119a-4bad-bb92-8c6838665bc5 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 204 len: 0 microversion: 2.1 time: 0.137033 Jun 27 21:20:13.469515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 291/573] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:20:13 2022] DELETE /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:13.479504 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:13.480222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:13.486567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.487096 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.487869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:13.488296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:13.621375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:13.629165 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-57d461ee-bc01-4021-8229-8288b63a1284 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1512 microversion: 2.1 time: 0.154423 Jun 27 21:20:13.629759 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 283/574] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:13 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:14.651686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:14.652896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:14.662394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:14.662845 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:14.663633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:14.664066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:14.803107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:14.813673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5cae7033-d723-4117-9ff1-e83de4316037 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1512 microversion: 2.1 time: 0.169229 Jun 27 21:20:14.814251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 292/575] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:14 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1512 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:15.834480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:15.835079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:15.841581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.842014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:15.842760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:15.843181 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.040150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:16.047954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-97fa7491-f332-40d6-adf2-1e2ecd8e0f7b tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1512 microversion: 2.1 time: 0.217823 Jun 27 21:20:16.048513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 284/576] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:15 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1512 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:16.416996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-148aae23-94e9-4b33-90fe-9773704588ab req-060dbff0-4d6d-49f4-b450-4daa0674d903 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c566bcaf-9d3a-4fa8-8c75-f059c5f89f94", "name": "network-vif-deleted", "tag": "0f860a24-eabf-4b54-9117-21516c666b44"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:16.421401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:16.428462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-148aae23-94e9-4b33-90fe-9773704588ab req-060dbff0-4d6d-49f4-b450-4daa0674d903 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:16.428984 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-148aae23-94e9-4b33-90fe-9773704588ab req-060dbff0-4d6d-49f4-b450-4daa0674d903 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:16.440373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-148aae23-94e9-4b33-90fe-9773704588ab req-060dbff0-4d6d-49f4-b450-4daa0674d903 service nova] Creating event network-vif-deleted:0f860a24-eabf-4b54-9117-21516c666b44 for instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 on hv-cinder-84773 Jun 27 21:20:16.445251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-148aae23-94e9-4b33-90fe-9773704588ab req-060dbff0-4d6d-49f4-b450-4daa0674d903 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031887 Jun 27 21:20:16.446066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 293/577] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:17.065171 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:17.065761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:17.072250 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.072690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.073440 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.073865 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.111085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:17.111543 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:17.111997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lazy-loading 'fault' on Instance uuid c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:17.154902 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:17.162557 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16d3517f-6b58-45c2-8864-0e6c00d54335 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 200 len: 1308 microversion: 2.1 time: 0.101346 Jun 27 21:20:17.163122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 285/578] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:17 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 1308 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:18.181854 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:18.182539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: c566bcaf-9d3a-4fa8-8c75-f059c5f89f94] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:18.189119 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.189564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:18.190311 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:18.190731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:18.204167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] HTTP exception thrown: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Request method failure captured: Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 HTTP/1.1 Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh7CuRzlmTe-1gy3kSrWN9exDV71EOaJQXFCKOexaNk1XbAIVJ65lPbKe9AEU9z1vC8dQgw3zg4j9Le8nsETZsg6byO8xQ-vP-W-vG1TgufATwEYnprNqendXjzN4Snob85yB7keavOT4rLGtoIZw9MkNVosiOK0nLKpDZotTUM1-Co Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 7457a8f362994239ad37f279eb57cf0a Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:20:18.205860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7457a8f362994239ad37f279eb57cf0a"}]}] Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 7457a8f362994239ad37f279eb57cf0a Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-VolumesSnapshotTestJSON-473802904-project Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 382e7a3612e348cc96c95dd3be986061 Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-VolumesSnapshotTestJSON-473802904-project Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. Jun 27 21:20:18.207245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'c566bcaf-9d3a-4fa8-8c75-f059c5f89f94'} Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:18.208082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. Jun 27 21:20:18.209387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:18.210444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Returning 404 to user: Instance c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:18.210444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-54b10f00-a5c6-4e6f-a047-3eaf821bacbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94" status: 404 len: 111 microversion: 2.1 time: 0.030158 Jun 27 21:20:18.210444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 294/579] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:18 2022] GET /compute/v2.1/servers/c566bcaf-9d3a-4fa8-8c75-f059c5f89f94 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:20:28.162663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-317135055", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "networks": [{"uuid": "dbf1c1b1-055e-4f33-8c19-ac43d1ef0a1b"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:28.169609 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=9 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:28.170214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=63,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:28.216931 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] validate_networks() for [('dbf1c1b1-055e-4f33-8c19-ac43d1ef0a1b', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:20:28.563389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:20:28.564124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:20:28.564768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:20:28.565169 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:20:28.565569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:20:28.575681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:28.576035 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:28.576827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:28.577218 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:28.595439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Getting quotas for project 7457a8f362994239ad37f279eb57cf0a. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:28.599352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Getting quotas for user 382e7a3612e348cc96c95dd3be986061 and project 7457a8f362994239ad37f279eb57cf0a. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:28.610483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:20:28.612811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:20:28.656937 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bff33c6f-30e8-452c-9f71-3aa4b78d63dc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.498040 Jun 27 21:20:28.657585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 286/580] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:20:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 499 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:20:28.667911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2c13026b-a71a-44c9-89b0-623e7ac6ba74 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:28.668590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2c13026b-a71a-44c9-89b0-623e7ac6ba74 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:28.670872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:28.671623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=34,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:28.726684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2c13026b-a71a-44c9-89b0-623e7ac6ba74 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:28.733349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2c13026b-a71a-44c9-89b0-623e7ac6ba74 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1218 microversion: 2.1 time: 0.069577 Jun 27 21:20:28.733909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 295/581] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:28 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1218 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:29.750665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:29.751294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:29.757777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.758216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.758966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:29.759394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:29.822151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:29.830671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-813d55e3-9e71-4c84-a4ec-ea13bffc514d tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1270 microversion: 2.1 time: 0.083982 Jun 27 21:20:29.838653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 287/582] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:29 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1270 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:30.847819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:30.848433 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:30.855287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.855715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.856506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:30.856930 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:30.998408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:31.006356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cedab111-493f-472e-9a08-d69f9ee758b8 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.162497 Jun 27 21:20:31.006959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 296/583] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:30 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:31.231891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-95cc76ac-ee1c-49c4-b1e5-c0ae3e5cabf9 req-c17ed016-5048-4ace-b4d3-c379866fc0d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca9790ee-bc2d-44a1-973b-030d36550f8f", "tag": "435f6b6c-70ca-4358-bd09-99f8a1302d10"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:31.241777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-95cc76ac-ee1c-49c4-b1e5-c0ae3e5cabf9 req-c17ed016-5048-4ace-b4d3-c379866fc0d4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:31.242273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-95cc76ac-ee1c-49c4-b1e5-c0ae3e5cabf9 req-c17ed016-5048-4ace-b4d3-c379866fc0d4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:31.256478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-95cc76ac-ee1c-49c4-b1e5-c0ae3e5cabf9 req-c17ed016-5048-4ace-b4d3-c379866fc0d4 service nova] Creating event network-changed:435f6b6c-70ca-4358-bd09-99f8a1302d10 for instance ca9790ee-bc2d-44a1-973b-030d36550f8f on hv-cinder-84773 Jun 27 21:20:31.261790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-95cc76ac-ee1c-49c4-b1e5-c0ae3e5cabf9 req-c17ed016-5048-4ace-b4d3-c379866fc0d4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033633 Jun 27 21:20:31.262370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 288/584] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:32.023656 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:32.024278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:32.030973 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.031418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.032216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:32.032637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:32.163793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:32.175478 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e8c03f26-54b3-458c-997f-e18c9e553ef6 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.155566 Jun 27 21:20:32.176321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 297/585] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:32 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:33.199423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:33.200421 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:33.207005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.207441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.208219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:33.208641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:33.419285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:33.427126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-89969cd2-bb82-4420-b099-3d6a1e5dddfc tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.234041 Jun 27 21:20:33.427711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 289/586] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:33 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:34.447889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:34.448842 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:34.460303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:34.461032 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:34.462265 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:34.462976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:34.596868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:34.604875 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-080f3801-b6cd-4c12-8d25-f7e76c28054c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.163543 Jun 27 21:20:34.605435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 298/587] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:34 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:35.623069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:35.623857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:35.630673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:35.631115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:35.631925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:35.632367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:35.765333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:35.773296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3bd9a76b-0bca-4ba2-bef1-e3bf186ab8c3 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.154493 Jun 27 21:20:35.773853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 290/588] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:35 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:36.794296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:36.795344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:36.806199 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:36.806946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:36.808246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:36.808964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:36.948212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:36.955638 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d0131990-07b8-4280-bb62-8f2788396d6e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.167857 Jun 27 21:20:36.956187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 299/589] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:36 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:37.747359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-e2e6366f-1cf6-44f2-ade8-d878e25a42f8 req-87b10ca3-1236-4db1-a740-078937ac522f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9790ee-bc2d-44a1-973b-030d36550f8f", "name": "network-vif-plugged", "status": "completed", "tag": "435f6b6c-70ca-4358-bd09-99f8a1302d10"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:37.755773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e2e6366f-1cf6-44f2-ade8-d878e25a42f8 req-87b10ca3-1236-4db1-a740-078937ac522f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:37.756357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-e2e6366f-1cf6-44f2-ade8-d878e25a42f8 req-87b10ca3-1236-4db1-a740-078937ac522f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:37.767741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-e2e6366f-1cf6-44f2-ade8-d878e25a42f8 req-87b10ca3-1236-4db1-a740-078937ac522f service nova] Creating event network-vif-plugged:435f6b6c-70ca-4358-bd09-99f8a1302d10 for instance ca9790ee-bc2d-44a1-973b-030d36550f8f on hv-cinder-84773 Jun 27 21:20:37.772611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-e2e6366f-1cf6-44f2-ade8-d878e25a42f8 req-87b10ca3-1236-4db1-a740-078937ac522f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028973 Jun 27 21:20:37.773392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 291/590] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:37.973627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:37.974207 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:37.981200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:37.981615 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:37.982465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:37.982885 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:38.113103 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:38.121312 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5e0ed949-e5a3-46ae-aa4d-610bb2ef809f tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.151725 Jun 27 21:20:38.121870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 300/591] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:37 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:39.137820 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:39.138569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:39.144440 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:39.145456 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:39.156045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:39.156580 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:39.157645 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:39.158067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:39.292022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:39.300113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d42f639a-6c0b-4dab-be56-0a70a1d98809 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1318 microversion: 2.1 time: 0.163933 Jun 27 21:20:39.300682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 292/592] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:39 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1318 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:40.163556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:40.164190 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.165984 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:40.171655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.172095 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.172851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.173421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.202482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-41359cde-12e4-4577-a41e-c1fbc22a88cd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments/f2528dfd-1ef0-452a-b8d8-7d328ceae6da" status: 200 len: 194 microversion: 2.20 time: 0.042813 Jun 27 21:20:40.203042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 301/593] 10.222.0.27 () {60 vars in 1453 bytes} [Mon Jun 27 21:20:40 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments/f2528dfd-1ef0-452a-b8d8-7d328ceae6da => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:20:40.268257 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:40.268816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.275113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.275545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.276326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.276753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.316793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:40.317439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.323966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.324440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.325199 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.325648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.360762 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lazy-loading 'services' on Instance uuid 07c8bb15-47a8-49ca-b240-c97ed0e24a43 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:20:40.435899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-68f252d7-e802-4a05-9b28-db39694f92a4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments/f2528dfd-1ef0-452a-b8d8-7d328ceae6da" status: 202 len: 0 microversion: 2.20 time: 0.171560 Jun 27 21:20:40.436487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 293/594] 10.222.0.27 () {60 vars in 1456 bytes} [Mon Jun 27 21:20:40 2022] DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments/f2528dfd-1ef0-452a-b8d8-7d328ceae6da => generated 0 bytes in 173 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:20:40.445537 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:40.446569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.452935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.453453 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.454439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.454670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.463056 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:40.470777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3a5e4f67-14f7-4ae1-9e8c-4ae8b0f2f117 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1506 microversion: 2.1 time: 0.157839 Jun 27 21:20:40.471691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 302/595] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:20:40 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1506 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:40.486700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "96cfea56-d46b-45a5-80d2-cc5a99220523", "device": "/dev/sdb"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:40.487836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:40.492833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-991a9005-fccd-496c-8e65-9319898b362e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051519 Jun 27 21:20:40.493399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 294/596] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 27 21:20:40 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:20:40.493903 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.494389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:40.495147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:40.495572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:41.225323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-403f4575-752e-40e9-923f-ac67cb9e5f03 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "POST /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.742380 Jun 27 21:20:41.226012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 303/597] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:20:40 2022] POST /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f/os-volume_attachments => generated 194 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:20:41.508380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:41.510089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:41.520368 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:41.521093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:41.522330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:41.523038 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:41.556427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ed3347a0-8a03-4625-8b56-2f84acbecbe2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055002 Jun 27 21:20:41.556974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 295/598] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 27 21:20:41 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:20:42.573986 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:42.575597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:42.583686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.584156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.584920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.585349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.614825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ab474ac9-4aa2-4098-957a-ab15401e4bf9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048888 Jun 27 21:20:42.615377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 304/599] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 27 21:20:42 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:20:42.673269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:42.673773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:42.680361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.680794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.681550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.681976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.713138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:20:42.793364 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eab5f5f4-2da3-473a-87c6-b73af7da9413 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 204 len: 0 microversion: 2.20 time: 0.123818 Jun 27 21:20:42.794298 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 296/600] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 27 21:20:42 2022] DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:20:42.804083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:42.805439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:42.815011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.815454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.816250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:42.816701 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:42.961312 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:42.972689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:42.974254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:42.975414 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-02b60c5b-25fb-44f7-8cac-b347f0152b64 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.176946 Jun 27 21:20:42.975975 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 305/601] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:42 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:43.999958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:44.000778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:44.008100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.008644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.009845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:44.010347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:44.143221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:44.151871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:44.153360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:44.154514 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-39851687-7dcd-46bb-9a06-a696ddedfc79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.159663 Jun 27 21:20:44.155182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 297/602] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:43 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:45.177328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:45.178153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:45.188958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.189397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.190158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:45.190584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:45.322842 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:45.331109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:45.332624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:45.333825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b4352200-e6e9-462b-ae0b-92ea7e508262 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1724 microversion: 2.20 time: 0.163219 Jun 27 21:20:45.334367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 306/603] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:45 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:46.296692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-f71c5f17-b80c-4753-94af-a30d11d3bbda req-a81996a0-bda8-4349-819c-f7c16353a91b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07c8bb15-47a8-49ca-b240-c97ed0e24a43", "name": "network-vif-deleted", "tag": "748794fb-6ea8-438b-a796-9301c13bd84d"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:46.306470 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f71c5f17-b80c-4753-94af-a30d11d3bbda req-a81996a0-bda8-4349-819c-f7c16353a91b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.306903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-f71c5f17-b80c-4753-94af-a30d11d3bbda req-a81996a0-bda8-4349-819c-f7c16353a91b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.318270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-f71c5f17-b80c-4753-94af-a30d11d3bbda req-a81996a0-bda8-4349-819c-f7c16353a91b service nova] Creating event network-vif-deleted:748794fb-6ea8-438b-a796-9301c13bd84d for instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 on hv-cinder-84773 Jun 27 21:20:46.324600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-f71c5f17-b80c-4753-94af-a30d11d3bbda req-a81996a0-bda8-4349-819c-f7c16353a91b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031548 Jun 27 21:20:46.325407 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 298/604] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:46.354727 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:46.355533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:46.366825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.367272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.368099 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.368531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.454541 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:46.462818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:46.464672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:46.466018 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b3b60508-096b-4442-8c17-6b527b122717 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 200 len: 1367 microversion: 2.20 time: 0.117766 Jun 27 21:20:46.467687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 307/605] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:46 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 1367 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:46.791009 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c3f64018-ec6f-4951-8ae3-dbbbd8428958"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:46.792189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:46.799188 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.799641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:46.800426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:46.800848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.119727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2f0727d-870a-4f0f-9634-d99a9ae7c0f6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.332927 Jun 27 21:20:47.120360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 299/606] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:20:46 2022] POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments => generated 194 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:47.489129 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:47.490074 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:47.500958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:47.501394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.502157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:47.502577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:47.517024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 HTTP/1.1 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:20:47.518687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:20:47.520166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '07c8bb15-47a8-49ca-b240-c97ed0e24a43'} Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:20:47.520979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:20:47.522499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:20:47.523590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:20:47.523590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c3b59635-674c-4ee2-ac82-3c0d5a82708b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 404 len: 111 microversion: 2.20 time: 0.038011 Jun 27 21:20:47.523590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 308/607] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:47 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:20:47.530313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0c2a580e-a0d1-4aa3-ae85-9f876091feea tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '.version_select at 0x7eff562dc3a0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:47.556791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0c2a580e-a0d1-4aa3-ae85-9f876091feea tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233059732" status: 204 len: 0 microversion: 2.20 time: 0.031160 Jun 27 21:20:47.557376 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 300/608] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 27 21:20:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1233059732 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:20:48.207058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-480e4c1e-396d-4152-9239-2e66fc6323a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: .version_select at 0x7eff55bc5040>, body: {"keypair": {"name": "tempest-keypair-1010850591", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtezSV0vvphZTJ+oSPzQRnIyiatw8fsndEldvzJoS44EVPYJ2n0GSSEWkq1J17OvTAxG0ggh6JDMuyKk+NpICnsgDeG5G4LnGxm8CAFoJw3U4ZIUUj0tkNFx2l+T1Dpsg=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:48.221122 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-480e4c1e-396d-4152-9239-2e66fc6323a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:48.224948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-480e4c1e-396d-4152-9239-2e66fc6323a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for user 74b2295521bc45509ef6b68c1885ac6e and project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:48.251850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-480e4c1e-396d-4152-9239-2e66fc6323a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.048695 Jun 27 21:20:48.252622 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 309/609] 10.222.0.27 () {62 vars in 1199 bytes} [Mon Jun 27 21:20:48 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 50 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 27 21:20:49.554024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1890148209", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9f1097eb-c5fa-4a13-a26e-fb4ec688ce90"}], "security_groups": [{"name": "tempest-securitygroup--1196125116"}], "key_name": "tempest-keypair-1010850591", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:49.655210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] validate_networks() for [('9f1097eb-c5fa-4a13-a26e-fb4ec688ce90', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:20:50.030213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:20:50.030639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:20:50.031100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:20:50.031502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:20:50.031928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:20:50.041273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.041716 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.042505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:50.042932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:50.059873 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:20:50.064150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Getting quotas for user 74b2295521bc45509ef6b68c1885ac6e and project 6b75fb163caa47cd9b72e047e9e050e2. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:20:50.075393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:20:50.077855 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:20:50.125086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2a238da-d0c4-4253-bf96-37040c65ebb8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.575963 Jun 27 21:20:50.125766 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 301/610] 10.222.0.27 () {62 vars in 1187 bytes} [Mon Jun 27 21:20:49 2022] POST /compute/v2.1/servers => generated 402 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 27 21:20:50.136963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:50.137637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:50.201744 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:50.208967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:50.210502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:50.211675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cb01fe85-4b16-4274-9f81-f1a0c602352d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1282 microversion: 2.20 time: 0.079513 Jun 27 21:20:50.212597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 310/611] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:50 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1282 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:20:51.233163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:51.233756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:51.242640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.243076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.243855 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:51.244274 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:51.319449 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:51.327746 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:51.329352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:51.330442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c6820d93-f63d-40a5-8f10-032ab1ebc3fc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1286 microversion: 2.20 time: 0.103286 Jun 27 21:20:51.331026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 302/612] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:51 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1286 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:52.348730 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:52.349300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:52.357082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:52.357519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:52.358272 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:52.358697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:52.420089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:52.428583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:52.430063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:52.431513 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d31499ee-48c8-4418-ae57-c0a0d3647e9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1334 microversion: 2.20 time: 0.086458 Jun 27 21:20:52.432184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 311/613] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:52 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1334 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:53.450638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:53.451254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:53.459274 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:53.459854 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:53.460688 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:53.461190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:53.479346 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:53.711001 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:53.719445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:53.721034 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:53.722357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-67947416-e02e-4d06-acc5-c9214a2b38e0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.275692 Jun 27 21:20:53.723078 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 303/614] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:53 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:54.743649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:54.744695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:54.753589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.754027 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.754781 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:54.755211 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:54.943950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:54.952135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:54.953627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:54.954724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b8e872bc-512d-49e2-9577-74c2db554814 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.217602 Jun 27 21:20:54.955283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 312/615] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:54 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:55.977003 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:55.977846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:55.987278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:55.987739 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:55.988749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:55.989181 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:56.127985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:56.136415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:56.138066 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:56.139156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d737a2e8-7260-4e9a-8cd2-d4dca281392e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.168820 Jun 27 21:20:56.139877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 304/616] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:55 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:56.805419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-a6e6bea4-2325-4ae9-898e-2e616dd57b2a req-766420fb-24b3-4d62-bfdc-a147f76a4c8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:56.816914 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-a6e6bea4-2325-4ae9-898e-2e616dd57b2a req-766420fb-24b3-4d62-bfdc-a147f76a4c8b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:56.817691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-a6e6bea4-2325-4ae9-898e-2e616dd57b2a req-766420fb-24b3-4d62-bfdc-a147f76a4c8b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:56.829955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-a6e6bea4-2325-4ae9-898e-2e616dd57b2a req-766420fb-24b3-4d62-bfdc-a147f76a4c8b service nova] Creating event network-changed:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:20:56.835427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-a6e6bea4-2325-4ae9-898e-2e616dd57b2a req-766420fb-24b3-4d62-bfdc-a147f76a4c8b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035334 Jun 27 21:20:56.836110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 313/617] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:20:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:20:57.157830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:57.158442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:57.166408 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.166835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.167590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:57.168044 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:57.337297 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:57.347388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:57.348896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:57.350021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-556a6bce-0db3-48bf-bac1-831f32ea8193 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.196468 Jun 27 21:20:57.350575 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 305/618] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:57 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:58.373725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:58.374704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:58.385173 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.385790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:58.386942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:58.387576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:58.407223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:58.522085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:58.530110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:58.531641 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:58.532765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-54bf5ce9-36d2-4d8d-bdbc-a18434b5d8d6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.166916 Jun 27 21:20:58.533318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 314/619] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:58 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:59.557684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:20:59.558361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:59.564130 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=6,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:59.570211 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.570649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.571483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.571936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.783227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:59.792064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:59.793565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:20:59.794681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d2ab456e-51c2-4ae4-9926-17d8f37c2be3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.242296 Jun 27 21:20:59.795205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 306/620] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:20:59 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:20:59.930911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:20:59.931899 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:20:59.934169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:20:59.940417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.940858 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.941782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:20:59.942189 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:20:59.967474 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'flavor' on Instance uuid 7205e394-41c3-4e4a-bb37-ef7902044cfd {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:00.095731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fcf00097-9d38-43d4-ae09-abd4e7b45742 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/action" status: 200 len: 32 microversion: 2.1 time: 0.168666 Jun 27 21:21:00.096334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 315/621] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:20:59 2022] POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/action => generated 32 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:21:00.105481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.106197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.109182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:00.109823 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:00.114135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.114577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.115333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.115794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.299459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:00.308069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c09b5ab4-6e6c-42d0-aee6-98534df61fe9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.206326 Jun 27 21:21:00.308765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 307/622] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:00 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:00.667769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:00.672273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.672921 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.679939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.680366 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.681143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.681588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.768902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lazy-loading 'services' on Instance uuid ca9790ee-bc2d-44a1-973b-030d36550f8f {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:00.813986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:00.815624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:00.824300 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.825068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.825635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:00.826062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:00.853836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dd470f94-fd1a-4b57-822f-34260e848cbe tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f/os-volume_attachments/96cfea56-d46b-45a5-80d2-cc5a99220523" status: 202 len: 0 microversion: 2.1 time: 0.186701 Jun 27 21:21:00.855080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 316/623] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:21:00 2022] DELETE /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f/os-volume_attachments/96cfea56-d46b-45a5-80d2-cc5a99220523 => generated 0 bytes in 189 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:01.050621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.059090 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.061466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.061793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aadae304-6e73-44ca-9b33-ef366d4a46b8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.252883 Jun 27 21:21:01.062392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 308/624] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:00 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:21:01.132247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:01.133147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:01.141585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.142027 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.142781 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.143206 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.167188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5abf76d4-d420-421c-b1ae-27927689ee2e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/ips" status: 200 len: 149 microversion: 2.1 time: 0.040089 Jun 27 21:21:01.167758 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 317/625] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:21:01 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/ips => generated 149 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:01.325740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:01.326343 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:01.332766 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.333206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.333961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:01.334385 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:01.517004 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:01.525560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5aaa1b15-9750-43a5-99d5-2474dcd57fde tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.203808 Jun 27 21:21:01.526131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 309/626] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:01 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:02.088843 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:02.089669 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:02.097899 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.098460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.099824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.100401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.248229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.257411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.259339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.260500 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d8dbfc19-15b7-490f-9945-069ed61154ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.177028 Jun 27 21:21:02.263768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 318/627] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:02 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:02.371700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-3546a178-ff63-4b45-bafe-462e8ee603a9 req-0f53ac00-6a4b-4c1e-ab91-108ace93101a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "name": "network-vif-plugged", "status": "completed", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:02.382337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3546a178-ff63-4b45-bafe-462e8ee603a9 req-0f53ac00-6a4b-4c1e-ab91-108ace93101a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.382770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-3546a178-ff63-4b45-bafe-462e8ee603a9 req-0f53ac00-6a4b-4c1e-ab91-108ace93101a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.394574 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-3546a178-ff63-4b45-bafe-462e8ee603a9 req-0f53ac00-6a4b-4c1e-ab91-108ace93101a service nova] Creating event network-vif-plugged:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:21:02.401941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-3546a178-ff63-4b45-bafe-462e8ee603a9 req-0f53ac00-6a4b-4c1e-ab91-108ace93101a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036807 Jun 27 21:21:02.402668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 310/628] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:02.531087 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab39080f-760a-4086-b77e-129ac5cab61d"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:02.532618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:02.538786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.539259 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.540169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.540603 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.545388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:02.545388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:02.551993 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.552430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.553194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:02.553618 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:02.739950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:02.751503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0ee36143-e528-4075-bf65-8a1ccde7b0a5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.212108 Jun 27 21:21:02.752229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 311/629] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:02 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:02.826959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-eefa47d2-ffa4-4091-a5bd-83a201913caf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299721 Jun 27 21:21:02.827563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 319/630] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:21:02 2022] POST /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:03.049123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:03.049617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:03.055977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.056418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.057181 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.057606 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.082751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:21:03.172560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0d20db01-06ae-4d2d-8969-c33ee2573665 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "DELETE /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 204 len: 0 microversion: 2.1 time: 0.126454 Jun 27 21:21:03.173463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 312/631] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:21:03 2022] DELETE /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:21:03.186306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:03.187738 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:03.194277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.194719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.195479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.195933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.279086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:03.279815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:03.286068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.286503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.287251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.287697 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.330299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.337983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-917dca04-e90d-43f0-9bdb-b629d8b07187 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1512 microversion: 2.1 time: 0.159554 Jun 27 21:21:03.338559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 320/632] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:03 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:03.424731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.432725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.434214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.435343 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-80cd5f25-345e-4b61-9fae-01d07de47584 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.160579 Jun 27 21:21:03.435929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 313/633] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:03 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:03.772461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:03.773408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:03.782739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.783184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.783984 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:03.784411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:03.925283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:03.933683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-17fc0d10-ab75-4d11-8d01-1fae7f7f3cdd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.167188 Jun 27 21:21:03.934535 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 321/634] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:03 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:04.358822 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.359694 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.366814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.367301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.368202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.368647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.457937 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.458650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.465631 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.466139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.467166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.467525 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.508041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.515960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1dd25774-78d0-432c-b8cd-31a273208215 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1512 microversion: 2.1 time: 0.163551 Jun 27 21:21:04.516518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 314/635] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1512 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:04.602130 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.614382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.616785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:04.618488 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-99488051-54ef-4659-b9c3-9723ce23b7e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1408 microversion: 2.20 time: 0.168329 Jun 27 21:21:04.619260 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 322/636] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:04.954029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:04.954651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:04.960983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.961418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:04.962162 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:04.962588 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.092092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.104653 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6d5b9d97-a97f-471e-8f4a-73d1d9f770ca tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.155938 Jun 27 21:21:05.105502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 315/637] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:04 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:05.533091 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.533821 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.540983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.541427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.542211 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.542614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.679365 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.688771 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9bb2de47-adc0-4a2d-b407-5ead3a5d5962 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1512 microversion: 2.1 time: 0.159599 Jun 27 21:21:05.689352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 323/638] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:05.701186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.701788 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.708008 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.708444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.709192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.709611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.842813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.851079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.852642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:05.854027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-74fd92c7-33ba-47f1-9dcd-4bc8ce18010c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1599 microversion: 2.20 time: 0.219249 Jun 27 21:21:05.854583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 316/639] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1599 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:05.871392 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:05.871958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:05.878025 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.878464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.879229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:05.879635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:05.960630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b11d2ecc-a548-4dfa-847a-4adc07d1d60a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093046 Jun 27 21:21:05.961275 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 324/640] 10.222.0.27 () {60 vars in 1315 bytes} [Mon Jun 27 21:21:05 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:21:06.123755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:06.124379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:06.130889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.131388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.132186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.132606 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.269013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:06.277657 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fd43a15a-50a8-44d4-9c60-d6684b823ce4 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.157914 Jun 27 21:21:06.278233 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 317/641] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:06 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:06.706060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:06.706658 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:06.713910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.715119 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:06.715547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:06.989641 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:06.999390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2dcfbb66-ba39-482e-94ab-9a7e0df0518c tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1512 microversion: 2.1 time: 0.297375 Jun 27 21:21:07.000162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 325/642] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:06 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1512 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:07.116114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-99e3bc57-f9a7-420b-815d-8665769754a2 req-0a86db83-ac58-4ec2-afa1-fd8951944974 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca9790ee-bc2d-44a1-973b-030d36550f8f", "name": "network-vif-deleted", "tag": "435f6b6c-70ca-4358-bd09-99f8a1302d10"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:07.142258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99e3bc57-f9a7-420b-815d-8665769754a2 req-0a86db83-ac58-4ec2-afa1-fd8951944974 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.142695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99e3bc57-f9a7-420b-815d-8665769754a2 req-0a86db83-ac58-4ec2-afa1-fd8951944974 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.170273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-99e3bc57-f9a7-420b-815d-8665769754a2 req-0a86db83-ac58-4ec2-afa1-fd8951944974 service nova] Creating event network-vif-deleted:435f6b6c-70ca-4358-bd09-99f8a1302d10 for instance ca9790ee-bc2d-44a1-973b-030d36550f8f on hv-cinder-84773 Jun 27 21:21:07.181317 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-99e3bc57-f9a7-420b-815d-8665769754a2 req-0a86db83-ac58-4ec2-afa1-fd8951944974 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076550 Jun 27 21:21:07.182000 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 318/643] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:07.296353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:07.298108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:07.308439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-dd7c2253-ab76-4e75-81cb-c4a9abd08981 req-116b564d-a328-4620-b2b1-459bc2e5d86e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:07.315380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.316486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.317286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.317916 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.338519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-dd7c2253-ab76-4e75-81cb-c4a9abd08981 req-116b564d-a328-4620-b2b1-459bc2e5d86e service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:07.339509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-dd7c2253-ab76-4e75-81cb-c4a9abd08981 req-116b564d-a328-4620-b2b1-459bc2e5d86e service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:07.364040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-dd7c2253-ab76-4e75-81cb-c4a9abd08981 req-116b564d-a328-4620-b2b1-459bc2e5d86e service nova] Creating event network-changed:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:21:07.369375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-dd7c2253-ab76-4e75-81cb-c4a9abd08981 req-116b564d-a328-4620-b2b1-459bc2e5d86e service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065223 Jun 27 21:21:07.370275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 319/644] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:07.465664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:07.473970 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fd2a5416-6bdf-4d68-9954-1adf1f4849df tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.183270 Jun 27 21:21:07.474539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 326/645] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:07 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:08.017224 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:08.018613 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.035462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.037146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.038570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.040118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.044776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:08.094340 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.094774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.095212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lazy-loading 'fault' on Instance uuid ca9790ee-bc2d-44a1-973b-030d36550f8f {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:08.137576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '382e7a3612e348cc96c95dd3be986061', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7457a8f362994239ad37f279eb57cf0a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.145835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-50ef4947-5504-46a2-a9eb-f8905adcc29e tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 200 len: 1308 microversion: 2.1 time: 0.132859 Jun 27 21:21:08.147380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 320/646] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:08 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 1308 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:08.491514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:08.492097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:08.498961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.499496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.500263 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:08.500700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:08.641511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:08.645132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:08.650781 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ea74b202-6933-4d3c-9c57-e2f63f17343e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.163363 Jun 27 21:21:08.651357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 327/647] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:08 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:09.167784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.168761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] [instance: ca9790ee-bc2d-44a1-973b-030d36550f8f] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.182522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.183585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.184921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.185652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.201179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] HTTP exception thrown: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Request method failure captured: Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f HTTP/1.1 Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh7CuRzlmTe-1gy3kSrWN9exDV71EOaJQXFCKOexaNk1XbAIVJ65lPbKe9AEU9z1vC8dQgw3zg4j9Le8nsETZsg6byO8xQ-vP-W-vG1TgufATwEYnprNqendXjzN4Snob85yB7keavOT4rLGtoIZw9MkNVosiOK0nLKpDZotTUM1-Co Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 7457a8f362994239ad37f279eb57cf0a Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:21:09.202845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/7457a8f362994239ad37f279eb57cf0a"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/7457a8f362994239ad37f279eb57cf0a"}]}] Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 7457a8f362994239ad37f279eb57cf0a Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-473802904 Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotTestJSON-473802904-project Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 382e7a3612e348cc96c95dd3be986061 Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotTestJSON-473802904-project Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. Jun 27 21:21:09.204386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'ca9790ee-bc2d-44a1-973b-030d36550f8f'} Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:21:09.205328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. Jun 27 21:21:09.206889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:09.208151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] Returning 404 to user: Instance ca9790ee-bc2d-44a1-973b-030d36550f8f could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:21:09.208151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-251e5c06-47c8-4ff3-9773-028b6733ac07 tempest-VolumesSnapshotTestJSON-473802904 tempest-VolumesSnapshotTestJSON-473802904-project] 10.222.0.27 "GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f" status: 404 len: 111 microversion: 2.1 time: 0.043078 Jun 27 21:21:09.208151 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 321/648] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/ca9790ee-bc2d-44a1-973b-030d36550f8f => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:21:09.673114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:09.674092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:09.685767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.686546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.687635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:09.688063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:09.818698 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:09.830465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1717de6e-d523-486d-8334-daafbb2fb306 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.164864 Jun 27 21:21:09.831223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 328/649] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:09 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:10.848247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:10.848903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:10.856638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:10.857123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:10.857950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:10.858420 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:11.010350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:11.019057 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2e0c4d92-2e1b-415a-a59e-91a83dce8364 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.175156 Jun 27 21:21:11.019636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 322/650] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:10 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:12.036552 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:12.037150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:12.045851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:12.046471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:12.047659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:12.048104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:12.185352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:12.193579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d7693812-f918-4735-bc6c-facce6a5e635 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.160931 Jun 27 21:21:12.194147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 329/651] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:12 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:13.214345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:13.215287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:13.226230 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.226963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.228252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:13.229027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:13.359686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:13.368140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c60004df-177e-4c65-80be-aeca719d8b1c tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.160228 Jun 27 21:21:13.368720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 323/652] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:13 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:14.391085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:14.392062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:14.402946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.404470 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:14.405757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:14.406477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:14.539732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:14.547920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-74645fc4-5508-4192-bb2e-ef5e028b63e7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.163354 Jun 27 21:21:14.548478 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 330/653] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:14 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:15.565479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:15.566031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:15.573445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.573953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.574727 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.575205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.713298 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:15.721784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e3d64cbc-cf1c-471d-9330-e95d399e2737 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.160238 Jun 27 21:21:15.722355 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 324/654] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:15 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:15.757892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab39080f-760a-4086-b77e-129ac5cab61d"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:15.759369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:15.765963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.766428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.767181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.767628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.847182 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: POST /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments HTTP/1.1 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 74 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:21:15.849086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {"volumeAttachment": {"volumeId": "ab39080f-760a-4086-b77e-129ac5cab61d"}} Jun 27 21:21:15.850679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': '1da3400a-6c47-4649-a431-48cc4c3ec236', 'body': {'volumeAttachment': {'volumeId': 'ab39080f-760a-4086-b77e-129ac5cab61d'}}} Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:15.851483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:15.852728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 400 to user: Invalid volume: volume ab39080f-760a-4086-b77e-129ac5cab61d is already attached to instances: 1da3400a-6c47-4649-a431-48cc4c3ec236 {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c10866fb-1007-4212-947e-38cede2a2871 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096735 Jun 27 21:21:15.854141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 331/655] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:21:15 2022] POST /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments => generated 174 bytes in 98 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 27 21:21:15.921449 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:15.922048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:15.928863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.929315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:15.930075 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:15.930497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.023893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'services' on Instance uuid 1da3400a-6c47-4649-a431-48cc4c3ec236 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:16.103231 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ae18587c-027c-4a9e-a5df-09b103d8eed7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments/ab39080f-760a-4086-b77e-129ac5cab61d" status: 202 len: 0 microversion: 2.1 time: 0.185654 Jun 27 21:21:16.103870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 325/656] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:21:15 2022] DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments/ab39080f-760a-4086-b77e-129ac5cab61d => generated 0 bytes in 187 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:16.114214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:16.115213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:16.122280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.122790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.123646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.124067 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.157492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-219bd7b2-dd4d-475a-a710-428a38f49907 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048434 Jun 27 21:21:16.158055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 332/657] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:16 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:16.739930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:16.740624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:16.747005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.747441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.748231 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:16.748652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:16.889318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:16.901895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a70218b1-30b3-4c64-bf9c-9f38934b8804 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.166678 Jun 27 21:21:16.902976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 326/658] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:16 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:17.169724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:17.170707 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:17.177347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.177783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.178540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.178964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.208766 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7e90c39b-d618-47c4-916e-bfe447ed225e tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043033 Jun 27 21:21:17.209341 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 333/659] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:17 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:17.921411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:17.922002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:17.928781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.929220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:17.929969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:17.930389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.064600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.072881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6fb33608-c16f-4029-8dd1-defd289be5d7 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.155472 Jun 27 21:21:18.073452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 327/660] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:17 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:18.221086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:18.222016 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:18.228804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.229250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.230005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.230463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.260143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-69d9995f-e0b6-48e4-b524-123cf9136328 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043052 Jun 27 21:21:18.260603 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 334/661] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:21:18 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:21:18.320948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:18.321468 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:18.327589 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.328058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.328804 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.329232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.353646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:21:18.432259 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-32c4334b-d733-4f53-adff-81d0df6f2ec2 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 204 len: 0 microversion: 2.1 time: 0.114934 Jun 27 21:21:18.432831 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 328/662] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:21:18 2022] DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:21:18.443049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:18.443686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:18.449756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.450219 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.450992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:18.451414 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:18.581264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:18.589393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-224bbda9-b85f-408f-a51e-bd9568c1cf09 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1678 microversion: 2.1 time: 0.151985 Jun 27 21:21:18.589956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 335/663] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:18 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:19.095098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:19.096288 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:19.107249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.108036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.109285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.109999 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.252480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.260985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-062b2209-fe98-4b06-adb5-f7060c2a201f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.173259 Jun 27 21:21:19.261561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 329/664] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:19 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:19.609864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:19.610893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:19.621635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.622359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.623599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:19.624369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:19.771851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:19.779751 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c2a12a82-e9fb-466b-ae5b-3bd40a2cc023 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1678 microversion: 2.1 time: 0.176388 Jun 27 21:21:19.780361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 336/665] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:19 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1678 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:20.278466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:20.279073 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:20.286020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.286455 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.287214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.287647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.426600 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:20.435211 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-be9d9000-5a8d-435f-a08e-0f76aee7dab0 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.160685 Jun 27 21:21:20.435799 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 330/666] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:20 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:20.800021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:20.800618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:20.807657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.808125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.808874 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:20.809301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:20.947953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:20.955588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f7a32f7d-2a63-49e9-90f9-3fd716102d67 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1678 microversion: 2.1 time: 0.161461 Jun 27 21:21:20.956180 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 337/667] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:20 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1678 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:21.453667 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:21.454321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:21.461351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.461792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.462548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.462976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.595354 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:21.603640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4bf52256-dbbf-4c7a-abb3-08a951d94239 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.153913 Jun 27 21:21:21.604345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 331/668] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:21 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:21.983474 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:21.986384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:21.991578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.992239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:21.992998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:21.993435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.127635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.135374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-729bdced-fbf2-4a7b-8392-2508a2df8f2b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1678 microversion: 2.1 time: 0.158299 Jun 27 21:21:22.135985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 338/669] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:21 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1678 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:22.624868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:22.625798 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:22.632830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:22.633582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.634343 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:22.634774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:22.792811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:22.801061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d6c4bff0-c778-4bd2-8a9e-70a98732d448 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.182600 Jun 27 21:21:22.801629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 332/670] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:22 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:23.157305 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:23.157893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:23.164970 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.165408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.166197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.166598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.301225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:23.309410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9890d2b1-d711-4edd-b47f-7cef77bfb1c4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1678 microversion: 2.1 time: 0.159038 Jun 27 21:21:23.309954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 339/671] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:23 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1678 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:23.819486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:23.820891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:23.828562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.829305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:23.830560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:23.831141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.112471 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:24.121919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85ce5b3e-ba9e-4979-83cc-ca4196f71e1e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.307200 Jun 27 21:21:24.122508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 333/672] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:23 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:24.327387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:24.327987 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:24.334862 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.335327 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.336114 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:24.336544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:24.399968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:24.407891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f75e0d6b-2ec6-4c90-b8b8-42bce69363a0 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1611 microversion: 2.1 time: 0.085326 Jun 27 21:21:24.408454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 340/673] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:24 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1611 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:24.997448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-0d85ef9d-9684-4f76-a5ed-a2ac9f5b33df req-ecd410f4-88a2-4b9d-ad58-62a0941eace7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1da3400a-6c47-4649-a431-48cc4c3ec236", "name": "network-vif-deleted", "tag": "3518c3e5-4f6e-4550-b82c-5f5fa154670e"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:25.005877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0d85ef9d-9684-4f76-a5ed-a2ac9f5b33df req-ecd410f4-88a2-4b9d-ad58-62a0941eace7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.006572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-0d85ef9d-9684-4f76-a5ed-a2ac9f5b33df req-ecd410f4-88a2-4b9d-ad58-62a0941eace7 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.018388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-0d85ef9d-9684-4f76-a5ed-a2ac9f5b33df req-ecd410f4-88a2-4b9d-ad58-62a0941eace7 service nova] Creating event network-vif-deleted:3518c3e5-4f6e-4550-b82c-5f5fa154670e for instance 1da3400a-6c47-4649-a431-48cc4c3ec236 on hv-cinder-84773 Jun 27 21:21:25.023791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-0d85ef9d-9684-4f76-a5ed-a2ac9f5b33df req-ecd410f4-88a2-4b9d-ad58-62a0941eace7 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091110 Jun 27 21:21:25.024382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 334/674] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:25.140148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:25.140679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:25.147000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.147437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.148225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.148649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.281324 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:25.292328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-78e6d58a-33ac-41a8-99a7-2a0b9a741b79 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1734 microversion: 2.1 time: 0.156488 Jun 27 21:21:25.301906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 341/675] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:25 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:25.426220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:25.426825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:25.433536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.433991 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.434734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.435154 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.456243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:25.470538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:25.470987 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:25.471441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 1da3400a-6c47-4649-a431-48cc4c3ec236 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:25.514251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:25.522041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2e16b441-a7e2-4865-a066-79c34090b4cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 200 len: 1329 microversion: 2.1 time: 0.100323 Jun 27 21:21:25.522599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 335/676] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:25 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 1329 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:26.313613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.314177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.321165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.321597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.322360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.322790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.473457 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:26.481872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c1731c8f-c428-41a7-95b5-0fb5d567186b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1714 microversion: 2.1 time: 0.174639 Jun 27 21:21:26.482482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 342/677] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:26 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1714 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:26.538360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.538868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.538998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.539197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.545388 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.545713 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.545877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.546143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.546564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.546883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.547043 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.547288 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.560646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 HTTP/1.1 Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:21:26.562258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:21:26.563862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '1da3400a-6c47-4649-a431-48cc4c3ec236'} Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:21:26.565434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:21:26.566872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.568334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:21:26.568334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1364346e-2f0f-441f-9905-4f47af14a92b tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 404 len: 111 microversion: 2.1 time: 0.029111 Jun 27 21:21:26.568334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 336/678] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:26 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:21:26.572125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aad78671-862f-439b-8179-628f765211ba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '.version_select at 0x7eff5638c0d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.590153 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aad78671-862f-439b-8179-628f765211ba tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-19496601" status: 202 len: 0 microversion: 2.1 time: 0.021480 Jun 27 21:21:26.590744 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 337/679] 10.222.0.27 () {58 vars in 1214 bytes} [Mon Jun 27 21:21:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-19496601 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:26.630527 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] HTTP exception thrown: Cannot 'detach_volume' instance 7205e394-41c3-4e4a-bb37-ef7902044cfd while it is in vm_state rescued Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Request method failure captured: Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments/c3f64018-ec6f-4951-8ae3-dbbbd8428958 HTTP/1.1 Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh5nhYV5-mHXqsRIsyeJyvLFShEA7le7yZj20PKtwqTHr_nxsNbILeRfunOZyWnZPPvc_uG7LTvfFTQR1YSmKj6USXUGVHatidMK6Gj-dJGrPYggxA_MKDQFSiurCQKrOiJzgw_ViDjG0qC86YzYOCorVo7gn0W_tmkXfD4Iq5X_c7I Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:21:26.632149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}] Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 92c1e4ea6ab84f94a2215f8c534ca159 Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:21:26.633967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Cannot 'detach_volume' instance 7205e394-41c3-4e4a-bb37-ef7902044cfd while it is in vm_state rescued Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': '7205e394-41c3-4e4a-bb37-ef7902044cfd', 'id': 'c3f64018-ec6f-4951-8ae3-dbbbd8428958'} Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:21:26.634784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7205e394-41c3-4e4a-bb37-ef7902044cfd while it is in vm_state rescued Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7205e394-41c3-4e4a-bb37-ef7902044cfd while it is in vm_state rescued Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:21:26.636241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Returning 409 to user: Cannot 'detach_volume' instance 7205e394-41c3-4e4a-bb37-ef7902044cfd while it is in vm_state rescued {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:21:26.637307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0bc7642f-9a3c-4b3d-bdf5-29bfe583518d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments/c3f64018-ec6f-4951-8ae3-dbbbd8428958" status: 409 len: 152 microversion: 2.1 time: 0.100669 Jun 27 21:21:26.637307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 343/680] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:21:26 2022] DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments/c3f64018-ec6f-4951-8ae3-dbbbd8428958 => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 27 21:21:26.644992 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:26.645520 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.651404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.651873 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.652630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.653058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.722286 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8cd98f6d-c796-4dba-b3cf-a1717857cd0b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/action" status: 202 len: 0 microversion: 2.1 time: 0.081129 Jun 27 21:21:26.723687 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 338/681] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:21:26 2022] POST /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:21:26.738479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:26.738479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:26.746898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.747539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.749211 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:26.750170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:26.790102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:27.018859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:27.027884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-430cc445-bc7a-43fe-835a-5e83fe7e7cd2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1722 microversion: 2.1 time: 0.298012 Jun 27 21:21:27.028551 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 344/682] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:26 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1722 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:27.306427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7ce3d0fb-d013-47b6-a08d-b05a57061822 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: .version_select at 0x7eff5644cd30>, body: {"keypair": {"name": "tempest-keypair-1118200545", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIk3pexeWAHXevgt5UCoNbb3A/zS6U5ZBM8MX9+rC5Uj8pJbOeSgngDejLG6AZpfU7+3xXDH0ZXOslQ7JHfVTRmBr8Rog12Vqi4vHgm/X59ECNeoA6D/InzjVhpvzI1ljg=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:27.320198 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7ce3d0fb-d013-47b6-a08d-b05a57061822 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:21:27.324155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-7ce3d0fb-d013-47b6-a08d-b05a57061822 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:21:27.348022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7ce3d0fb-d013-47b6-a08d-b05a57061822 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045774 Jun 27 21:21:27.348542 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 339/683] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:21:27 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:28.047193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:28.049350 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:28.057079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.057896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.058850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:28.059501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:28.281815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:28.290907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-16105b11-00ba-4513-bd64-4100a7d2301a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1722 microversion: 2.1 time: 0.249115 Jun 27 21:21:28.291458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 345/684] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:28 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:28.693237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1257825749", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "496540cf-a3b9-4c39-b571-4063a80b6b12"}], "security_groups": [{"name": "tempest-securitygroup--279484379"}], "key_name": "tempest-keypair-1118200545", "user_data": "}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:28.794180 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] validate_networks() for [('496540cf-a3b9-4c39-b571-4063a80b6b12', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:21:29.243789 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:21:29.244208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:21:29.244674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:21:29.245225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:21:29.245657 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:21:29.247794 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:29.256775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.257227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.258320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.258751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.278285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:21:29.282624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Getting quotas for user 30cbde26a1964f22902c24917006fb90 and project 0b5921bd9539401d9a235ccde185632b. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:21:29.295095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:21:29.297696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:21:29.311106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:29.313754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:29.321432 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.321868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.322628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.323052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.349330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a20b5ed3-21c0-44bb-92ab-238073951688 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.660873 Jun 27 21:21:29.354905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 340/685] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:21:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 663 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 27 21:21:29.361101 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7efb5451-2987-4932-8693-564a00639fd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:29.361791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7efb5451-2987-4932-8693-564a00639fd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:29.426583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7efb5451-2987-4932-8693-564a00639fd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.434479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7efb5451-2987-4932-8693-564a00639fd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1242 microversion: 2.1 time: 0.077927 Jun 27 21:21:29.435562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 341/686] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:29 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1242 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:29.477251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:29.486868 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c591d3ab-cacc-4120-88d0-8ebedf02e313 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1728 microversion: 2.1 time: 0.181582 Jun 27 21:21:29.487436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 346/687] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:29 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1728 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:29.502946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:29.503500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:29.510595 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.511030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.511826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:29.512242 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:29.594232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-71c41e69-28e6-4ab8-adc0-7ec70a32ad90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.095080 Jun 27 21:21:29.599745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 342/688] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:21:29 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:30.455798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:30.456516 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:30.460817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=64 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:30.465148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.465712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.468136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.469102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.578849 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:30.589467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0b584357-7291-40ef-8706-5a07fdb8e417 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1302 microversion: 2.1 time: 0.140793 Jun 27 21:21:30.590049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 347/689] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:30 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1302 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:21:30.796048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-99d0b544-41f7-449b-a7b5-f49a9ca85f6f req-b45249ea-5ee2-44af-8d0c-37c2021a4843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:30.810252 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99d0b544-41f7-449b-a7b5-f49a9ca85f6f req-b45249ea-5ee2-44af-8d0c-37c2021a4843 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:30.810983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-99d0b544-41f7-449b-a7b5-f49a9ca85f6f req-b45249ea-5ee2-44af-8d0c-37c2021a4843 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:30.829761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-99d0b544-41f7-449b-a7b5-f49a9ca85f6f req-b45249ea-5ee2-44af-8d0c-37c2021a4843 service nova] Creating event network-changed:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:21:30.837108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-99d0b544-41f7-449b-a7b5-f49a9ca85f6f req-b45249ea-5ee2-44af-8d0c-37c2021a4843 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046885 Jun 27 21:21:30.837717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 343/690] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:21:31.606259 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:31.606872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:31.613872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:31.614344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:31.615111 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:31.615531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:31.882405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:31.896963 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6767df36-94d9-4c05-8b83-eda17a8c0dd1 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.294482 Jun 27 21:21:31.900413 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 348/691] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:31 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:32.350983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-8ca21fd0-8bb9-4abb-a718-64b6f87b9804 req-9ec3c41b-04f5-44c5-8fb1-f19459fd2948 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfdf0f7-f64d-4f00-aa3b-ce58b327200e", "tag": "8a5a8d43-3ba7-46cf-842d-bc561144c0b0"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:32.359441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8ca21fd0-8bb9-4abb-a718-64b6f87b9804 req-9ec3c41b-04f5-44c5-8fb1-f19459fd2948 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.360291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8ca21fd0-8bb9-4abb-a718-64b6f87b9804 req-9ec3c41b-04f5-44c5-8fb1-f19459fd2948 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:32.381032 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-8ca21fd0-8bb9-4abb-a718-64b6f87b9804 req-9ec3c41b-04f5-44c5-8fb1-f19459fd2948 service nova] Creating event network-changed:8a5a8d43-3ba7-46cf-842d-bc561144c0b0 for instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e on hv-cinder-84773 Jun 27 21:21:32.389005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-8ca21fd0-8bb9-4abb-a718-64b6f87b9804 req-9ec3c41b-04f5-44c5-8fb1-f19459fd2948 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041826 Jun 27 21:21:32.391072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 344/692] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:32.852417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-31173d7b-7594-4106-a786-1c087c6b8dac req-a0e7d0ee-5b57-4567-938f-1e0581b447f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:32.862347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-31173d7b-7594-4106-a786-1c087c6b8dac req-a0e7d0ee-5b57-4567-938f-1e0581b447f9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.862906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-31173d7b-7594-4106-a786-1c087c6b8dac req-a0e7d0ee-5b57-4567-938f-1e0581b447f9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:32.875661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-31173d7b-7594-4106-a786-1c087c6b8dac req-a0e7d0ee-5b57-4567-938f-1e0581b447f9 service nova] Creating event network-changed:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:21:32.881029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-31173d7b-7594-4106-a786-1c087c6b8dac req-a0e7d0ee-5b57-4567-938f-1e0581b447f9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032280 Jun 27 21:21:32.881738 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 349/693] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:32.918370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:32.919084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:32.925886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.926312 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:32.927081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:32.927493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:33.065622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:33.076663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a7c6f90-80db-4939-8c1c-eaf6ed1a89d6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.162323 Jun 27 21:21:33.077463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 345/694] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:32 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:34.099320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:34.100122 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:34.107257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:34.107748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:34.108552 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:34.108922 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:34.252476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:34.260620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9e2c1db8-9156-4f65-a206-f6e9e50eb6a7 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.165773 Jun 27 21:21:34.261255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 350/695] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:34 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:35.282219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:35.282921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:35.290936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:35.291453 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:35.292375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:35.292877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:35.447671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:35.459046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-25e42a3a-3f02-48b5-b027-9be397476d53 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.182899 Jun 27 21:21:35.459787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 346/696] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:35 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:36.476015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:36.476612 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:36.483570 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.484076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.484861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:36.485283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:36.614828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:36.625879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2ff88e7b-25be-43ca-ae7e-a1995615e966 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.153740 Jun 27 21:21:36.626390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 351/697] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:36 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:37.646251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:37.647302 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:37.657585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.658044 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.658778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:37.659203 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:37.794775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:37.802554 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2b8220bb-865c-484f-b2f5-2c3b69f021b6 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.162674 Jun 27 21:21:37.803128 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 347/698] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:37 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:38.558197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-3e589a4c-b8bd-4a72-814f-53d41b968ca7 req-1c1c9400-b7dc-4315-930e-1c65be9f727a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfdf0f7-f64d-4f00-aa3b-ce58b327200e", "name": "network-vif-plugged", "status": "completed", "tag": "8a5a8d43-3ba7-46cf-842d-bc561144c0b0"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:38.566781 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3e589a4c-b8bd-4a72-814f-53d41b968ca7 req-1c1c9400-b7dc-4315-930e-1c65be9f727a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.567216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3e589a4c-b8bd-4a72-814f-53d41b968ca7 req-1c1c9400-b7dc-4315-930e-1c65be9f727a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.580628 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-3e589a4c-b8bd-4a72-814f-53d41b968ca7 req-1c1c9400-b7dc-4315-930e-1c65be9f727a service nova] Creating event network-vif-plugged:8a5a8d43-3ba7-46cf-842d-bc561144c0b0 for instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e on hv-cinder-84773 Jun 27 21:21:38.585557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-3e589a4c-b8bd-4a72-814f-53d41b968ca7 req-1c1c9400-b7dc-4315-930e-1c65be9f727a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031066 Jun 27 21:21:38.586498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 352/699] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:38.819622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:38.820226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:38.828332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.828749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.829512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:38.829932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:38.965663 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:38.977341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3661c75c-7ed4-459c-b2b9-119ee0175854 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.161171 Jun 27 21:21:38.978056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 348/700] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:38 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:39.997352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:39.998044 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:40.005762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:40.006167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:40.007144 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:40.007943 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:40.156801 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:40.164559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-baf54d98-30db-4e7e-a670-c4da1dc5d497 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1367 microversion: 2.1 time: 0.171950 Jun 27 21:21:40.165151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 353/701] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:39 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:41.185503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:41.186527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:41.189539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:41.190658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=12 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:41.201431 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.202148 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.203336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.203782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.346139 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:41.354138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8aa6dabe-14e5-4cd9-b353-1eb27c6534cf tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1557 microversion: 2.1 time: 0.174974 Jun 27 21:21:41.354703 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 349/702] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:21:41 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1557 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:21:41.371945 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:41.372438 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:41.379234 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.379767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.380528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:41.380955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:41.461550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5f1398ab-cf20-43bf-af9d-96f9f802be8d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093441 Jun 27 21:21:41.462150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 354/703] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:21:41 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:42.619448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-b9df6b1f-a11b-42d0-8014-157aeb93f39b req-1e22b894-7c6c-4220-9946-74644174e134 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0bfdf0f7-f64d-4f00-aa3b-ce58b327200e", "tag": "8a5a8d43-3ba7-46cf-842d-bc561144c0b0"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:42.627837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b9df6b1f-a11b-42d0-8014-157aeb93f39b req-1e22b894-7c6c-4220-9946-74644174e134 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:42.628266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b9df6b1f-a11b-42d0-8014-157aeb93f39b req-1e22b894-7c6c-4220-9946-74644174e134 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:42.639586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-b9df6b1f-a11b-42d0-8014-157aeb93f39b req-1e22b894-7c6c-4220-9946-74644174e134 service nova] Creating event network-changed:8a5a8d43-3ba7-46cf-842d-bc561144c0b0 for instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e on hv-cinder-84773 Jun 27 21:21:42.644670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-b9df6b1f-a11b-42d0-8014-157aeb93f39b req-1e22b894-7c6c-4220-9946-74644174e134 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.210296 Jun 27 21:21:42.645225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 350/704] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:21:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:21:43.433619 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:43.434226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:43.442001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:43.442450 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:43.443261 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:43.443732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:43.468593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e0a57080-ba1d-4244-8ad7-ec70743f3dd9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/ips" status: 200 len: 151 microversion: 2.20 time: 0.041000 Jun 27 21:21:43.469140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 355/705] 10.222.0.27 () {60 vars in 1288 bytes} [Mon Jun 27 21:21:43 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:21:45.849790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:21:45.850714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:45.860085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:45.860518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:45.861266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:45.861685 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:45.884348 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lazy-loading 'flavor' on Instance uuid f053f1bf-afc5-418f-b4b7-1adf492ee9a2 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:21:46.141467 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8242ada6-e060-4385-bb08-ce031fe633ed tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/action" status: 202 len: 0 microversion: 2.20 time: 0.298937 Jun 27 21:21:46.142085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 351/706] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 27 21:21:45 2022] POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/action => generated 0 bytes in 301 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:21:46.150580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:46.151183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:46.158052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:46.158481 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:46.159400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:46.159892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:46.295554 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.304014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.305545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:46.306799 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-426c4bb3-0766-479c-9fbf-210e924d31c2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.160526 Jun 27 21:21:46.307377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 356/707] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:46 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:47.330936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:47.331649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:47.338630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:47.339068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:47.339868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:47.340300 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:47.486411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:47.494815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:47.496340 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:47.497481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7330021e-0c04-4612-acc8-869f56e9d4d7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.172819 Jun 27 21:21:47.498037 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 352/708] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:47 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:48.518774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:48.519650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:48.529129 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:48.529750 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:48.530929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:48.531358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:48.660080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.670358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.672180 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:48.673361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-572d2948-a75f-4aae-844d-35d1b1709a1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.160197 Jun 27 21:21:48.673919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 357/709] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:48 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:49.695726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:49.696744 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:49.706205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.706633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.707388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:49.707851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:49.851793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:49.860002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:49.861494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:49.862615 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df202d0c-deb6-4ac0-a5f7-29f971bea9d1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.173427 Jun 27 21:21:49.863169 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 353/710] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:49 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:50.885456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:50.886483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:50.894711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:50.895149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:50.895929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:50.896355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:51.037704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.045835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.047469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:51.048647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c79acdb8-ae47-4fde-abbc-e8262de1a93f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.170186 Jun 27 21:21:51.049181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 358/711] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:50 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:52.070689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:52.071737 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:52.082760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:52.083478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:52.084793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:52.085500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:52.239236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.247640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.249123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:52.250278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5b445d8e-3e1f-4c8c-8cee-9f3bd4a37520 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.186347 Jun 27 21:21:52.250846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 354/712] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:52 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:53.275417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:53.276429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:53.286953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:53.287707 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:53.289056 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:53.289769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:53.431683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:53.439998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:53.441483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:53.442670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-42f61162-1bc1-4bc6-b78c-da5cc3ac1df1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.173790 Jun 27 21:21:53.443223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 359/713] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:53 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:54.465247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:54.466284 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:54.474050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:54.474487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:54.475278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:54.475767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:54.493919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:54.606772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.614787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.616303 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:54.617436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5d3fd0d1-9297-4d3d-9af6-0a03168dd6a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.158695 Jun 27 21:21:54.617987 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 355/714] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:54 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:55.640012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:55.640668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:55.648229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.648721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.649558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:55.650039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:55.792904 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.801230 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.802712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:55.803886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a8a96a6d-c759-474e-8e3e-78c4a0366735 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.170457 Jun 27 21:21:55.804445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 360/715] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:55 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:56.823310 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:56.824079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:56.832277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:56.832770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:56.833660 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:56.834160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:56.974509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.982835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.984503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:56.985688 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d572764f-561a-4491-92b4-d7b524b9af9f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.166967 Jun 27 21:21:56.986237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 356/716] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:56 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:58.004881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:58.005487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:58.012689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:58.013125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.013874 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:58.014302 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:58.017050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=87 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:21:58.151438 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.158370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.159892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:58.161049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9fcc2142-d283-41fe-8983-70fc37f837fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.160136 Jun 27 21:21:58.161604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 361/717] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:57 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:21:59.188901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:21:59.189891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:21:59.200992 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.201742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.203049 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:21:59.203475 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:21:59.344969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.353262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.354739 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:21:59.355926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-88fa3166-ebde-440c-8955-b290428fe562 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.173874 Jun 27 21:21:59.356502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 357/718] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:21:59 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:00.378426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:00.379383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:00.390589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.391329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.392614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:00.393331 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:00.534777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.545013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.546533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:00.547954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4471f752-3887-4769-ade9-b844427b4b91 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.176102 Jun 27 21:22:00.548748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 362/719] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:00 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:01.576911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:01.578121 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:01.580843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:01.587736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:01.588181 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:01.589056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:01.589556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:01.734501 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.742933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.744466 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:01.745615 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-41d9c530-34de-42ae-ac68-1188305c2b2a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.176703 Jun 27 21:22:01.746172 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 358/720] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:01 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:02.764622 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:02.764990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:02.770429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=32 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:02.772757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.773203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.773976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:02.774401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:02.913442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:02.924882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:02.926377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:02.927529 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2e83cbc8-ba8d-4907-b390-cc97797471ef tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.167350 Jun 27 21:22:02.928174 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 363/721] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:02 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:03.950472 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:03.951510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:03.959006 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.959439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:03.960210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:03.960631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:04.101997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:04.115289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:04.117785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:04.119670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5d37de2a-78f1-409e-8707-b777b79e0a00 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.175488 Jun 27 21:22:04.120599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 359/722] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:03 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:05.142687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:05.143204 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:05.150279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.150722 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.151587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.152051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.292421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:05.300598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:05.302096 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:05.303254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4acd80e6-be45-486a-af8d-726e9d6d9b47 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.165808 Jun 27 21:22:05.303851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 364/723] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:05 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:05.652139 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:05.653008 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:05.660962 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.661399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.662163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.662587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.686857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lazy-loading 'flavor' on Instance uuid f815a1a9-fea2-4c2a-ac39-8bf72e05d970 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:05.763817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ca92c0bd-0cab-4304-91e4-9efc70bffac3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "POST /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970/action" status: 202 len: 0 microversion: 2.1 time: 0.118119 Jun 27 21:22:05.764363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 360/724] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:22:05 2022] POST /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:05.773486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:05.774146 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:05.780328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.780882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.781711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:05.782176 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:05.919502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:05.928209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-025c7dd2-c9ea-4e87-9f2b-49405ef2b588 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.159376 Jun 27 21:22:05.928819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 365/725] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:05 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:06.326536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:06.327777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:06.338140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.338868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.340163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.340872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.486189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:06.494306 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:06.495814 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:06.496959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-27415c47-5854-44b3-b9e0-2cee5e8031e1 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.177663 Jun 27 21:22:06.497514 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 361/726] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:06 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:06.945708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:06.946297 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:06.953240 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.953685 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:06.954454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:06.954875 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.087575 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:07.095318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d4b9b081-ed95-44db-9330-93142e251cfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.153443 Jun 27 21:22:07.095867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 366/727] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:06 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:07.516881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:07.517464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:07.524297 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.524734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.525510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.525930 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.673418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:07.681844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:07.683351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:07.684545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-387176b5-bca8-4076-8e12-cc46e92ad7d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1745 microversion: 2.20 time: 0.171801 Jun 27 21:22:07.685094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 362/728] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:07 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:07.802957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:07.803704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:07.813052 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.813495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.814253 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.814678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.841441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:07.917910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-034ee5a7-ef85-4f8e-a9b4-646ea1baf3c6 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 204 len: 0 microversion: 2.1 time: 0.120809 Jun 27 21:22:07.918954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 367/729] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:07 2022] DELETE /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:07.926756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:07.927562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:07.934767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.935200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:07.935991 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:07.936500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.074007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:08.085225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9362da22-e99d-436b-84b2-ab2cf0135fb7 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1577 microversion: 2.1 time: 0.162229 Jun 27 21:22:08.085999 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 363/730] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:07 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:08.113507 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:08.114191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:08.121256 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.121695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.122466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.122891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.254697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:08.262487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a77b4861-bab0-4b1c-a0f7-e5c7e9cf0e58 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.153229 Jun 27 21:22:08.263046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 368/731] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:08 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:08.702949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:08.703579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:08.710314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.710761 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.711525 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.711983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.842311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:08.850920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:08.852484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:08.853611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7a71d51a-369f-488e-8b0d-801891f6e95f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1745 microversion: 2.20 time: 0.154680 Jun 27 21:22:08.854205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 364/732] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:08 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:08.914718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:08.915204 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:08.921566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.922025 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:08.922798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:08.923222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.008930 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'services' on Instance uuid 7205e394-41c3-4e4a-bb37-ef7902044cfd {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:09.081004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-aa78111b-cb66-4a63-91c1-3efa6dc8dae9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments/c3f64018-ec6f-4951-8ae3-dbbbd8428958" status: 202 len: 0 microversion: 2.1 time: 0.170081 Jun 27 21:22:09.081587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 369/733] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:22:08 2022] DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments/c3f64018-ec6f-4951-8ae3-dbbbd8428958 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:09.089840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.090810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.096823 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.097258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.098002 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.098436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.105526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.106225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.112912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.113360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.114159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.114881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.129139 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cffa40b6-859d-4143-bb70-5fec1f180b50 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043125 Jun 27 21:22:09.129908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 365/734] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:09 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:09.254849 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:09.266692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-99074c30-8b26-48f2-b167-366c37c2a9fd tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1577 microversion: 2.1 time: 0.165104 Jun 27 21:22:09.267386 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 370/735] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:09 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1577 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:09.279363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.279941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.286154 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.286592 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.287406 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.287857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.432733 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:09.440733 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-99ed4770-c2c0-4d1d-bc4c-138df2f63be4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.165333 Jun 27 21:22:09.441291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 366/736] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:09 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:09.876076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:09.877058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:09.887964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.888690 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:09.889976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:09.890404 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.019729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:10.027708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:10.029188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:10.030381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5e862e3a-d029-4271-8e5d-e9f115481d03 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1745 microversion: 2.20 time: 0.160876 Jun 27 21:22:10.030970 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 371/737] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:09 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:10.143621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.144809 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.154618 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.155191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.156130 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.156549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.185390 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e5ac0982-9353-415c-9882-934336e8297a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047889 Jun 27 21:22:10.185925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 367/738] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:10 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:10.286191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.286800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.293708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.294148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.294899 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.295324 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.438777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:10.451109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-581ccba9-c141-43a2-a70f-58a5945073e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1577 microversion: 2.1 time: 0.168418 Jun 27 21:22:10.451859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 372/739] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:10 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1577 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:10.458121 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:10.458723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:10.465543 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.465975 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.466720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.467137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.610103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:10.618494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5b514c19-fabb-46a2-8716-d2ac22b28d86 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.164107 Jun 27 21:22:10.619204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 368/740] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:10 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:10.739150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-b255325c-77b9-4725-8844-2a68ba74fd06 req-caf7b367-ffdf-4ace-882e-085c461fed57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "name": "network-vif-plugged", "status": "completed", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:10.749148 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-b255325c-77b9-4725-8844-2a68ba74fd06 req-caf7b367-ffdf-4ace-882e-085c461fed57 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:10.749684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-b255325c-77b9-4725-8844-2a68ba74fd06 req-caf7b367-ffdf-4ace-882e-085c461fed57 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:10.762519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-b255325c-77b9-4725-8844-2a68ba74fd06 req-caf7b367-ffdf-4ace-882e-085c461fed57 service nova] Creating event network-vif-plugged:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:22:10.767820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-b255325c-77b9-4725-8844-2a68ba74fd06 req-caf7b367-ffdf-4ace-882e-085c461fed57 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096933 Jun 27 21:22:10.768547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 373/741] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:11.055392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.056022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.062309 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.063136 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.063501 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.064080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.203393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.205364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.219507 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.220353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.221680 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.222458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.280631 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7c226262-2e00-4d27-85ca-4a54df9409cd tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085342 Jun 27 21:22:11.282166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 374/742] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:11 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments => generated 197 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:11.356464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:11.366432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:11.367946 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:11.369265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-87f81852-0ca9-40a2-abc5-e701862ce33f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.318643 Jun 27 21:22:11.375685 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 369/743] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:11 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:11.473397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.474969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.481807 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.482713 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.483857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.484634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.636677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:11.637567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:11.645021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.645721 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.646751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:11.647400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:11.661981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:11.673195 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fc7e5e4b-3583-4427-988f-3d20d1edf06b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1577 microversion: 2.1 time: 0.204657 Jun 27 21:22:11.674379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 375/744] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:11 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1577 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:11.682549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:11.934154 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:11.942265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b1f33a26-6ea1-47d0-a9a3-3fda6bfbb699 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.309983 Jun 27 21:22:11.952554 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 370/745] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:11 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:12.155113 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-0e125efa-85c6-48af-88f1-13098f3e43ee req-fc44326e-a2ce-4e9a-b493-07e13a3ed591 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f989e41d-0c15-4c0b-b96b-4286820a9b48", "name": "network-vif-deleted", "tag": "d1b2f6c6-acc1-474f-a4a1-618f87168c62"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:12.192429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-0e125efa-85c6-48af-88f1-13098f3e43ee req-fc44326e-a2ce-4e9a-b493-07e13a3ed591 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.193239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-0e125efa-85c6-48af-88f1-13098f3e43ee req-fc44326e-a2ce-4e9a-b493-07e13a3ed591 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.214169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:12.230915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-0e125efa-85c6-48af-88f1-13098f3e43ee req-fc44326e-a2ce-4e9a-b493-07e13a3ed591 service nova] Creating event network-vif-deleted:d1b2f6c6-acc1-474f-a4a1-618f87168c62 for instance f989e41d-0c15-4c0b-b96b-4286820a9b48 on hv-cinder-84773 Jun 27 21:22:12.238993 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-0e125efa-85c6-48af-88f1-13098f3e43ee req-fc44326e-a2ce-4e9a-b493-07e13a3ed591 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086556 Jun 27 21:22:12.239281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 376/746] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:12.294029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.294965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.303106 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.303550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.304353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.304774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.348316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c2c55025-1f5c-4f38-822b-db8339522bc2 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058157 Jun 27 21:22:12.349677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 371/747] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:12 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 27 21:22:12.389620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.390407 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.407767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.408285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.409131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.409736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.440951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.442056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.454425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.455179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.456651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.457246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.504907 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:12.644791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-98ebdb3e-1366-4e22-9bb7-7c0315048bac tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 204 len: 0 microversion: 2.1 time: 0.207414 Jun 27 21:22:12.647659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 372/748] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:12 2022] DELETE /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 0 bytes in 210 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:12.659479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:12.674426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:12.677508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.678557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:12.680643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.684228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-eb811aa4-08e4-46af-a340-66c87bc409b3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.297330 Jun 27 21:22:12.695820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 377/749] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:12 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:12.698833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.699273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.702997 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.703974 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.711599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.712287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.712421 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.712845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.713655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.714309 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.806217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:12.822621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7a23a616-71a9-45a7-a70d-aa5010431bbc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1225 microversion: 2.1 time: 0.125320 Jun 27 21:22:12.835223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 378/750] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:12 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1225 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:12.888817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:12.897777 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ee2ee741-7b80-408b-9a75-5b7d0b479ac9 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.243571 Jun 27 21:22:12.899932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 373/751] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:12 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:12.959349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:12.960161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:12.967423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.968193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:12.969532 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:12.970133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.122042 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:13.129879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-81e0f063-5d71-45d3-9742-c92da781550b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.175346 Jun 27 21:22:13.139545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 379/752] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:12 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:13.706554 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:13.707241 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:13.715097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.715926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.716874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.717310 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.840732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:13.841325 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:13.851318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.851855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.852672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.853352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.875586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:13.886417 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:13.888042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:13.889553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3ad0e830-f083-49d3-af6c-ca673926f98a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.190665 Jun 27 21:22:13.900547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 374/753] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:13 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:13.917966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:13.918737 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:13.925411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.925964 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.926887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:13.927447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:13.938670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:13.946533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c2904842-4d18-40c8-8ba5-06d44f0958c5 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1225 microversion: 2.1 time: 0.109631 Jun 27 21:22:13.947508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 380/754] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:13 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1225 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:14.089095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:14.097363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ecf25449-064c-441a-bcda-70224a730b86 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.185230 Jun 27 21:22:14.098011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 375/755] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:13 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:14.152564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:14.153345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:14.164332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.164774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:14.165680 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.166120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:14.310301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:14.318905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-44073575-7f5e-450a-a708-a83a8036661d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.172766 Jun 27 21:22:14.329069 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 381/756] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:14 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:14.910778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:14.911940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:14.918766 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.919203 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:14.919978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.920404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:14.963748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:14.964347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:14.973394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.973394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:14.973394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:14.973394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.070437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.082055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-93573ae7-2bb5-4e41-89e8-66ca7dd350ba tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1225 microversion: 2.1 time: 0.122015 Jun 27 21:22:15.082646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 382/757] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:14 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1225 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:15.117603 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:15.118208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:15.122013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.130327 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.131214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.132277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.132775 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.133713 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.135216 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.136436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bc756482-9a24-4708-a73f-282e455908ff tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.232111 Jun 27 21:22:15.147661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 376/758] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:14 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:15.279600 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.290735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1c4bfdb0-6d0d-422c-b7aa-500a64c5cc83 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.177116 Jun 27 21:22:15.295057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 383/759] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:15 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:15.337016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:15.338035 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:15.344668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.345110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.345864 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:15.346287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:15.488635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:15.499933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5d78a748-4785-4e38-bbc9-c7f48472fa7d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.167299 Jun 27 21:22:15.500731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 377/760] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:15 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:16.098833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:16.100186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:16.108020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.108460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.109229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.109655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.157929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:16.159289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:16.166445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.166978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.167851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.168350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.186214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.200341 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7d9d3345-1374-4814-b7eb-46956560375b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1225 microversion: 2.1 time: 0.105824 Jun 27 21:22:16.211642 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 384/761] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:16 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:16.310234 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.310778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:16.311540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:16.317832 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.320577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.320742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.320851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.320954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.321050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.321854 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-41e3f079-942a-4614-987e-c2521f5c4e01 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.170048 Jun 27 21:22:16.323159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 378/762] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:16 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:16.481298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.489765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-926b38b7-9867-4a60-8be3-ff252f372264 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.183557 Jun 27 21:22:16.490777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 385/763] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:16 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:16.517336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:16.517948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:16.524072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.524522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.525284 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:16.525718 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:16.683076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:16.693580 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-233858e9-5c69-4ffd-8b0b-b0b043551c00 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.180222 Jun 27 21:22:16.694461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 379/764] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:16 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:17.225866 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:17.228133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:17.235004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.235574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.236388 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.236790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.277251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.277691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.278129 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lazy-loading 'fault' on Instance uuid f989e41d-0c15-4c0b-b96b-4286820a9b48 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:17.320036 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:17.329678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64e131da-95de-4e6f-91d3-271cff2c4f41 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 200 len: 1230 microversion: 2.1 time: 0.109212 Jun 27 21:22:17.331735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 386/765] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:17 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 1230 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:17.341975 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:17.342985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:17.349889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.350380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.351213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.351672 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.511466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:17.512519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:17.523539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.530522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.532506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.533112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.568316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:17.591451 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:17.596084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:17.598051 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3f4deeb8-eefe-4b6a-b334-ba57d01062f9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.260135 Jun 27 21:22:17.599326 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 380/766] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:17 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:17.715538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:17.716259 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:17.717655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:17.729951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bc0a2463-affa-4079-a223-409405cc3410 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.223047 Jun 27 21:22:17.730894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 387/767] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:17 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:17.733389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.736174 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:17.737021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:17.737457 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.348490 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:18.348490 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:18.350295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:18.355032 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.355732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.356581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.357084 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.358013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-61a3f68c-20e9-44e1-a403-21d4e4995419 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.648895 Jun 27 21:22:18.367676 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 381/768] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:17 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:18.381579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] HTTP exception thrown: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Request method failure captured: Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 HTTP/1.1 Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh6e-sQE7fymYcGSY9dyBrvGNY633PXjW-Mxo6ylyvGFlQIXnudT7o-irMgow8Qv1GarsZVk1-5zkHehLNpF7O04qyEiiy64s96AU2CUhr-LLlBSuAFv8-ifyHcXXLwHVD9bUilm-LeUaYWzoRpJOv4tWC15NIGesbp5pF0XeMKDf1A Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:18.383345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}] Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 32b9a1c24fe84019a311b1331ea2c004 Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:22:18.384840 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'f989e41d-0c15-4c0b-b96b-4286820a9b48'} Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:18.385646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:22:18.386861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:18.389979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Returning 404 to user: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:18.389979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f0284edc-94f2-4a29-a072-ad0b545a8782 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 404 len: 111 microversion: 2.1 time: 0.042264 Jun 27 21:22:18.400647 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 388/769] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:18 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:22:18.528636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1694435101", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367607908", "security_groups": [{"name": "tempest-secgroup-smoke-52619586"}], "block_device_mapping_v2": [{"uuid": "b31b3e95-3b6c-435e-a7d7-50337148633f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:18.617273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:18.618205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:18.625208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.625749 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.626582 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.627069 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.757982 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] validate_networks() for [('b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:22:18.792181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:18.801175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:18.803207 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:18.806456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-75dcdc9b-5f9a-4df5-82d1-30aceae06777 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.191038 Jun 27 21:22:18.815570 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 389/770] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:18 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:18.821188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:18.821798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:18.829508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.830092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.831252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:18.831982 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:18.998784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:19.007878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-63e9f377-b8ca-4d8c-8a56-524dc8a0a7a6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1688 microversion: 2.1 time: 0.190978 Jun 27 21:22:19.010061 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 390/771] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:18 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1688 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:19.374737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:19.377089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:19.388128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.388930 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.391446 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.392841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.577457 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:19.590081 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b1b9f8f2-25c4-4dbc-ab0d-cdcfab0d9323 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.219315 Jun 27 21:22:19.591172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 391/772] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:19 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:19.667070 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:22:19.668176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:22:19.668798 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:22:19.669355 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:22:19.670251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:22:19.674873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-3ed07fd8-a078-4c32-8ff9-29c3fcf7fa25 req-662da93b-671c-4ac3-8a6b-8d7354b66719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7205e394-41c3-4e4a-bb37-ef7902044cfd", "name": "network-vif-deleted", "tag": "391dc19c-e42a-40e7-9e87-7d108a1b00db"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:19.680900 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.681661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.682609 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.683308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.691201 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3ed07fd8-a078-4c32-8ff9-29c3fcf7fa25 req-662da93b-671c-4ac3-8a6b-8d7354b66719 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.691463 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3ed07fd8-a078-4c32-8ff9-29c3fcf7fa25 req-662da93b-671c-4ac3-8a6b-8d7354b66719 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.716538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-3ed07fd8-a078-4c32-8ff9-29c3fcf7fa25 req-662da93b-671c-4ac3-8a6b-8d7354b66719 service nova] Creating event network-vif-deleted:391dc19c-e42a-40e7-9e87-7d108a1b00db for instance 7205e394-41c3-4e4a-bb37-ef7902044cfd on hv-cinder-84773 Jun 27 21:22:19.717813 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:22:19.725795 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for user 32b9a1c24fe84019a311b1331ea2c004 and project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:22:19.732837 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-3ed07fd8-a078-4c32-8ff9-29c3fcf7fa25 req-662da93b-671c-4ac3-8a6b-8d7354b66719 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061464 Jun 27 21:22:19.734087 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 392/773] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:19.803519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:22:19.806116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b31b3e95-3b6c-435e-a7d7-50337148633f',volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:22:19.828249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:19.828249 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:19.837294 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.837882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:19.838769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:19.839290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.061494 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.070308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.071850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.072005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-24d95015-90b0-401c-9d6d-fbfc87560eeb tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.546395 Jun 27 21:22:20.072581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 382/774] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:22:18 2022] POST /compute/v2.1/servers => generated 404 bytes in 1549 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:22:20.079124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:20.079956 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:20.086957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-88e6dcf1-b2cb-4c35-82d8-7b6c7388e787 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.265361 Jun 27 21:22:20.087501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 393/775] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:19 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:20.088482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.089068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.089998 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.090553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.095456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2c245eb3-f998-44c2-a42c-e369a0c53424 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:20.096299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2c245eb3-f998-44c2-a42c-e369a0c53424 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:20.167142 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2c245eb3-f998-44c2-a42c-e369a0c53424 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.180726 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2c245eb3-f998-44c2-a42c-e369a0c53424 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1094 microversion: 2.1 time: 0.087201 Jun 27 21:22:20.181277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 394/776] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:20 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1094 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:20.205921 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.214337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9e6136e-5931-4fa4-9d85-27cddbe1dbef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1621 microversion: 2.1 time: 0.139827 Jun 27 21:22:20.214916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 383/777] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:20 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1621 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:20.607397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:20.608057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:20.615264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.615759 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.616535 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:20.616961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:20.644581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:20.786869 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:20.794783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8ed89fda-6d9c-46b0-a63d-469263daf9e5 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.191500 Jun 27 21:22:20.795387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 395/778] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:20 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:21.104913 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:21.106139 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:21.113665 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.114321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.115273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.115714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.199598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:21.200490 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:21.212164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.212820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.213743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.214163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.263265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.271647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.273379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.274801 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9c7cf53a-6dd3-4afe-882d-e954153a02bc tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1740 microversion: 2.20 time: 0.174206 Jun 27 21:22:21.275506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 384/779] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:21 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:21.287236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.291114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:21.291775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:21.298353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.298789 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.299557 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.300012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.306017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b4fcda37-04b7-4d20-94d2-300e44b300a8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1192 microversion: 2.1 time: 0.112142 Jun 27 21:22:21.317468 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 396/780] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:21 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1192 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:21.348146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.351464 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.353049 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'fault' on Instance uuid 7205e394-41c3-4e4a-bb37-ef7902044cfd {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:21.358145 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:21.417179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.424832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-59bb6b05-935d-4eb2-9703-4f101ee32a22 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 200 len: 1334 microversion: 2.1 time: 0.137342 Jun 27 21:22:21.425401 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 385/781] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:21 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 1334 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:21.812129 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:21.812737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:21.819581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.820062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.821019 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:21.821601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:21.964726 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:21.974523 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1559c5d6-5e0d-456b-ba18-b9c1e7c3230d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.166405 Jun 27 21:22:21.975097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 397/782] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:21 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:22.293763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.294332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:22.301285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.301729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.302482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.302909 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.323812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.324411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:22.330898 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.331329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.332158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.332581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.396094 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:22.403396 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-10ddbff7-30d7-4fc9-9c32-dbc7cea4efce tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1210 microversion: 2.1 time: 0.083494 Jun 27 21:22:22.404060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 398/783] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:22 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1210 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:22.437215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:22.441860 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.442469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 7205e394-41c3-4e4a-bb37-ef7902044cfd] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:22.445486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:22.446988 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:22.448178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3eaecf2d-9347-4e20-851e-67d08f1815a8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1722 microversion: 2.20 time: 0.158456 Jun 27 21:22:22.448465 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.448741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 386/784] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:22 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:22.449011 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.449723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:22.450155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:22.463380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] HTTP exception thrown: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Request method failure captured: Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd HTTP/1.1 Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh5nhYV5-mHXqsRIsyeJyvLFShEA7le7yZj20PKtwqTHr_nxsNbILeRfunOZyWnZPPvc_uG7LTvfFTQR1YSmKj6USXUGVHatidMK6Gj-dJGrPYggxA_MKDQFSiurCQKrOiJzgw_ViDjG0qC86YzYOCorVo7gn0W_tmkXfD4Iq5X_c7I Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:22.465024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}] Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 92c1e4ea6ab84f94a2215f8c534ca159 Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. Jun 27 21:22:22.466587 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '7205e394-41c3-4e4a-bb37-ef7902044cfd'} Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:22.467626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. Jun 27 21:22:22.469131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:22.470719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Returning 404 to user: Instance 7205e394-41c3-4e4a-bb37-ef7902044cfd could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:22.470719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d0ace4d6-415c-42d1-92f3-d7f311282916 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd" status: 404 len: 111 microversion: 2.1 time: 0.028359 Jun 27 21:22:22.470719 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 399/785] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:22 2022] GET /compute/v2.1/servers/7205e394-41c3-4e4a-bb37-ef7902044cfd => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 27 21:22:22.474805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d077f8e3-5a5d-495d-9f2b-e072790c66e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '.version_select at 0x7eff562caaf0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.493413 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d077f8e3-5a5d-495d-9f2b-e072790c66e5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-288437692" status: 202 len: 0 microversion: 2.1 time: 0.022308 Jun 27 21:22:22.493942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 387/786] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 27 21:22:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-288437692 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:22.992348 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:22.992950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:22.999539 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.000004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.000788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.001194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.134980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.143304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5d6874b3-4e11-4dc4-80a8-7e897d544a8b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1510 microversion: 2.1 time: 0.155344 Jun 27 21:22:23.143993 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 400/787] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:22 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1510 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:23.161443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:23.162254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:23.172526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.173084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.174361 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.175055 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.267790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ec814ba5-4201-4445-8f91-271b202ddcb7 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "POST /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970/action" status: 202 len: 0 microversion: 2.1 time: 0.110540 Jun 27 21:22:23.277409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:23.278387 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:23.283341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 388/788] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:22:23 2022] POST /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:23.285293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.285776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.286549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.286975 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.420565 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:23.421388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:23.428984 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.429617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.430590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.431332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.497566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.506262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-89d32b20-2d2c-484a-9bd8-f335a5146c17 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1518 microversion: 2.1 time: 0.232512 Jun 27 21:22:23.515739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 401/789] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:23 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1518 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:23.520290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:23.520877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:23.527330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.527890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.528681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:23.529104 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:23.599203 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.609255 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-229fa1c5-993d-4fe9-91b1-cea8a9cde694 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1198 microversion: 2.1 time: 0.192593 Jun 27 21:22:23.610289 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 389/790] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:23 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1198 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:23.682296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.690753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.692383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:23.693675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-51c28be4-5e26-41f3-b50c-735e75b6dbae tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1722 microversion: 2.20 time: 0.185468 Jun 27 21:22:23.694580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 402/791] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:23 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1722 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:24.524018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:24.524616 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:24.531291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.531770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.532518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.532940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.626334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:24.627083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:24.636440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.637947 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.639405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.641206 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.678617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.690671 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d06719da-a570-4d7b-8094-312a2042c467 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1520 microversion: 2.1 time: 0.170490 Jun 27 21:22:24.701122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 390/792] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:24 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1520 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:24.701122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-2edc9c13-7431-4922-a199-b9d7c0fb9fe1 req-847f5d52-bafc-4934-9b80-01ac2f019c55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "name": "network-vif-unplugged", "status": "completed", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:24.709621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2edc9c13-7431-4922-a199-b9d7c0fb9fe1 req-847f5d52-bafc-4934-9b80-01ac2f019c55 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.710272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2edc9c13-7431-4922-a199-b9d7c0fb9fe1 req-847f5d52-bafc-4934-9b80-01ac2f019c55 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.726145 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.compute.server_external_events [req-2edc9c13-7431-4922-a199-b9d7c0fb9fe1 req-847f5d52-bafc-4934-9b80-01ac2f019c55 service nova] Unable to find a host for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970. Dropping event network-vif-unplugged {{(pid=117893) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 27 21:22:24.726947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-2edc9c13-7431-4922-a199-b9d7c0fb9fe1 req-847f5d52-bafc-4934-9b80-01ac2f019c55 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.033712 Jun 27 21:22:24.727732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 391/793] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:24 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 35 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 27 21:22:24.733057 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:24.733651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:24.741619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.742209 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.742985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:24.743414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:24.808633 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.816389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bb0b97d5-bffb-4126-86a8-f866cdd361d3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.193895 Jun 27 21:22:24.816962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 403/794] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:24 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:24.873826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.882169 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.883634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:24.884771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ae8bc112-dc60-4e81-9c76-e7df5690f4fb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1722 microversion: 2.20 time: 0.155955 Jun 27 21:22:24.885312 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 392/795] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:24 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:25.709103 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:25.709715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:25.716401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.716897 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.717656 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.718087 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.837123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:25.838722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:25.850445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.851358 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.852320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.855458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.862802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:25.871485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-aa7f75a9-ce9f-4217-ae4d-caffe7da633c tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1520 microversion: 2.1 time: 0.166379 Jun 27 21:22:25.872732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 404/796] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:25 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:25.878481 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:25.879389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:25.886831 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.887382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.888262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.888880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.913282 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-881ae5b0-2f2b-4868-bc19-cc4972ff6894 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/ips" status: 200 len: 150 microversion: 2.1 time: 0.039228 Jun 27 21:22:25.913966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 405/797] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:22:25 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/ips => generated 150 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:25.924340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:25.925145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:25.932741 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.933252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:25.934295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:25.934808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.125954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.137827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.139495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.140777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5cf81d13-cf05-4373-8c1a-37940d84cddd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1722 microversion: 2.20 time: 0.225895 Jun 27 21:22:26.141723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 406/798] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:25 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1722 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:26.170836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.182718 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a0b16a8a-61b8-4124-95b5-7075470db197 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.352539 Jun 27 21:22:26.184391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 393/799] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:25 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:26.475741 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:26.476426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:26.484785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.485236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.486066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.486639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.515687 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:26.529880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-78775e3e-89d3-4280-bf17-06879ee905dd req-74bdb3a6-d7c1-4a5a-afef-9db116eac678 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9fa96-14c9-46b3-a1fc-a9a1d2a99762", "tag": "d9fd079e-447c-4359-acd1-aea7c7b6d077"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:26.542597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:26.556115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-78775e3e-89d3-4280-bf17-06879ee905dd req-74bdb3a6-d7c1-4a5a-afef-9db116eac678 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.556806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-78775e3e-89d3-4280-bf17-06879ee905dd req-74bdb3a6-d7c1-4a5a-afef-9db116eac678 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.569504 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-78775e3e-89d3-4280-bf17-06879ee905dd req-74bdb3a6-d7c1-4a5a-afef-9db116eac678 service nova] Creating event network-changed:d9fd079e-447c-4359-acd1-aea7c7b6d077 for instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 on hv-cinder-84773 Jun 27 21:22:26.575033 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-78775e3e-89d3-4280-bf17-06879ee905dd req-74bdb3a6-d7c1-4a5a-afef-9db116eac678 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051109 Jun 27 21:22:26.575866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 394/800] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:26.594765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:26.611697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-08d47da8-15cd-408a-85fb-176d3f79df1d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 204 len: 0 microversion: 2.1 time: 0.142001 Jun 27 21:22:26.612621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 407/801] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:26 2022] DELETE /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:26.620938 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:26.621638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:26.628520 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.628968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.629896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.630152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.746208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-e84556b9-6e9d-498c-b9c7-7140838df5cc req-f677085e-d3ef-4dfb-81e7-a64fd2aec58f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "name": "network-vif-unplugged", "status": "completed", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:26.758467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e84556b9-6e9d-498c-b9c7-7140838df5cc req-f677085e-d3ef-4dfb-81e7-a64fd2aec58f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.759427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e84556b9-6e9d-498c-b9c7-7140838df5cc req-f677085e-d3ef-4dfb-81e7-a64fd2aec58f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.773890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-e84556b9-6e9d-498c-b9c7-7140838df5cc req-f677085e-d3ef-4dfb-81e7-a64fd2aec58f service nova] Creating event network-vif-unplugged:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:22:26.778964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-e84556b9-6e9d-498c-b9c7-7140838df5cc req-f677085e-d3ef-4dfb-81e7-a64fd2aec58f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.037950 Jun 27 21:22:26.779813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 408/802] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:26.782752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:26.796742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-44fa2624-f6d4-4d56-ace9-d550b5430bd3 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1508 microversion: 2.1 time: 0.179981 Jun 27 21:22:26.797322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 395/803] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:26 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1508 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:26.890748 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:26.891435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:26.898181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.898625 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:26.899394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:26.899863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.034055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.042232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a636ddc2-38df-4460-bb70-c02d7aae1f2d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.155830 Jun 27 21:22:27.042791 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 409/804] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:26 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:27.162439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:27.163425 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.172812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.173249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.174007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.174430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.199394 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:27.200029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.206682 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.207121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.207907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.208334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.309735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.319219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.320715 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.321884 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d621e99e-96b2-4bce-9371-c1ea762b603f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1665 microversion: 2.20 time: 0.165954 Jun 27 21:22:27.334523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 396/805] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:27 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1665 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:27.339872 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1bf1c324-fa24-4441-bcd9-4b08689b6922"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:27.340940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.341055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:27.347994 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.348439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.348650 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e4ba6865-ec5d-4d13-9056-a74cd2208173 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.153063 Jun 27 21:22:27.349206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.349350 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 410/806] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:27 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:27.349904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.355128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6a2b6cb-53b9-4806-b7aa-59f33f950d90"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:27.356271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.362161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.362607 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.363363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.363818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.642536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-14264ef2-8b43-4492-a1ee-53e7d0f40ee0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.306594 Jun 27 21:22:27.643332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 397/807] 10.222.0.27 () {62 vars in 1363 bytes} [Mon Jun 27 21:22:27 2022] POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments => generated 188 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 27 21:22:27.758804 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:27.759295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:27.768416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.768791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:27.769549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:27.769968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.030149 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=7,nova_cell1:INSERT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:28.041388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e230853-d048-4c5c-b80a-a3525c1a681f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments/1bf1c324-fa24-4441-bcd9-4b08689b6922" status: 202 len: 0 microversion: 2.20 time: 0.286988 Jun 27 21:22:28.041992 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 398/808] 10.222.0.27 () {60 vars in 1456 bytes} [Mon Jun 27 21:22:27 2022] DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments/1bf1c324-fa24-4441-bcd9-4b08689b6922 => generated 0 bytes in 288 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:28.046484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:28.047084 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.053215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.053654 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.054402 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.054829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.186316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.194803 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-350ff841-7440-4826-bfce-c79f33748bef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1508 microversion: 2.1 time: 0.151791 Jun 27 21:22:28.195563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 399/809] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:28 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:28.200495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:28.201146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.207536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.208012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.208764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.209185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.345541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.353587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-19b91c7c-cd5a-4231-ac37-2f259a18901b tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.156906 Jun 27 21:22:28.354155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 400/810] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:28 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:28.358731 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:28.359272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.366607 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.367175 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.368306 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.368914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.456854 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a41b248a-5213-4012-8ef2-a76c5179dc8d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/action" status: 202 len: 0 microversion: 2.20 time: 0.101656 Jun 27 21:22:28.457531 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 401/811] 10.222.0.27 () {62 vars in 1318 bytes} [Mon Jun 27 21:22:28 2022] POST /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/action => generated 0 bytes in 103 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:28.462270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:28.462873 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.469129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.469568 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.470339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.470901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.611359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.618941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-25005dca-d2a8-4db3-a32b-5768003b28cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.160464 Jun 27 21:22:28.619642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 402/812] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:28 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:28.624062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:28.624655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:28.630882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.631322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.632107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:28.632534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:28.783363 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.791993 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.793674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:28.794989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-20cddaeb-2af1-453c-b1a4-f825622db774 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1673 microversion: 2.20 time: 0.174435 Jun 27 21:22:28.795548 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 403/813] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:28 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1673 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:29.300798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:29.355703 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:29.356969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:29.364443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.365337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.366389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.367041 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.449000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ac7a9ed7-5835-4606-95e1-9f7ad3a7a8b9 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "POST /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.097118 Jun 27 21:22:29.450020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 411/814] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:22:27 2022] POST /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments => generated 194 bytes in 2099 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:29.480368 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:29.481551 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:29.499163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.499627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.506398 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.506916 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.695432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:29.714819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:29.739920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-07baed1c-13c5-49f7-8e60-14fc8e88c162 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1508 microversion: 2.1 time: 0.529409 Jun 27 21:22:29.742006 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 404/815] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:29 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1508 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:29.750136 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:29.750866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:29.752799 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:29.765945 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.766379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.767455 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.768053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.844824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:29.855136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3775b58c-6fda-4f5c-a9e6-f45c8c949155 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.402751 Jun 27 21:22:29.864055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 412/816] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:29 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:29.870827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:29.871525 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:29.878208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.878778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:29.879553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:29.880032 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.095973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.103193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.126222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-da13d5b1-fac7-41ca-8581-c6b6f5c32b81 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.380703 Jun 27 21:22:30.127068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 405/817] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:29 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:30.128974 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.130992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.132212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bce49dab-fdc1-41ca-9bd9-10f6715d26d0 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1673 microversion: 2.20 time: 0.266789 Jun 27 21:22:30.132754 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 413/818] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:29 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1673 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:30.251011 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-4874ff73-3621-4dd9-80ae-d850f1a98fa6 req-58feaf75-5563-4a23-b024-80a880fcb112 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "70f4d3a8-09f4-4af2-bc4d-cdde099122cc", "name": "network-vif-deleted", "tag": "dde7eb9d-cc48-430f-8fba-2d67e531c828"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:30.260546 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4874ff73-3621-4dd9-80ae-d850f1a98fa6 req-58feaf75-5563-4a23-b024-80a880fcb112 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.261127 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-4874ff73-3621-4dd9-80ae-d850f1a98fa6 req-58feaf75-5563-4a23-b024-80a880fcb112 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.275624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-4874ff73-3621-4dd9-80ae-d850f1a98fa6 req-58feaf75-5563-4a23-b024-80a880fcb112 service nova] Creating event network-vif-deleted:dde7eb9d-cc48-430f-8fba-2d67e531c828 for instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc on hv-cinder-84773 Jun 27 21:22:30.280850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-4874ff73-3621-4dd9-80ae-d850f1a98fa6 req-58feaf75-5563-4a23-b024-80a880fcb112 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033686 Jun 27 21:22:30.281529 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 406/819] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:30.757789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:30.758684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:30.760910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:30.767332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.767924 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.768825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.769348 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.803884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.804325 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.804777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'fault' on Instance uuid 70f4d3a8-09f4-4af2-bc4d-cdde099122cc {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:30.846402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:30.853817 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e6d06698-9929-4aa6-9e3b-ea967c043e78 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 200 len: 1312 microversion: 2.1 time: 0.100360 Jun 27 21:22:30.854383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 414/820] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:30 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:30.872911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:30.873633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:30.879880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.880647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:30.881453 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:30.881889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.027079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:31.036032 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-db6b6b98-7a4a-4b7b-a896-e23ec33797fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.167156 Jun 27 21:22:31.036701 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 407/821] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:30 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:31.146629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:31.147345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:31.150431 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:31.151089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:31.154757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.155194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.156153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.156589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.158846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.159294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.160087 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.160512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.289046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:31.291332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:31.296894 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-583acd01-4c78-49c9-9139-887aacdfa09e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.155400 Jun 27 21:22:31.297482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 415/822] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:31 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:31.299906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:31.301502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:31.302651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5c548ebb-d23f-4ebf-aa8a-2be284130872 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.156334 Jun 27 21:22:31.303229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 408/823] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:31 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:31.870524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:31.871118 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 70f4d3a8-09f4-4af2-bc4d-cdde099122cc] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:31.878047 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.878458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.879236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.879663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.893865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] HTTP exception thrown: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Request method failure captured: Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc HTTP/1.1 Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh5nhYV5-mHXqsRIsyeJyvLFShEA7le7yZj20PKtwqTHr_nxsNbILeRfunOZyWnZPPvc_uG7LTvfFTQR1YSmKj6USXUGVHatidMK6Gj-dJGrPYggxA_MKDQFSiurCQKrOiJzgw_ViDjG0qC86YzYOCorVo7gn0W_tmkXfD4Iq5X_c7I Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:31.895501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}] Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 92c1e4ea6ab84f94a2215f8c534ca159 Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. Jun 27 21:22:31.897225 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '70f4d3a8-09f4-4af2-bc4d-cdde099122cc'} Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:31.898092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. Jun 27 21:22:31.899769 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:31.901013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Returning 404 to user: Instance 70f4d3a8-09f4-4af2-bc4d-cdde099122cc could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:31.901013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b54dcb25-c7fb-4f14-a548-0cb18fa97b39 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc" status: 404 len: 111 microversion: 2.1 time: 0.030357 Jun 27 21:22:31.901013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 416/824] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:31 2022] GET /compute/v2.1/servers/70f4d3a8-09f4-4af2-bc4d-cdde099122cc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:31.906230 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:31.906934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:31.913176 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.913690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.914515 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:31.915007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:31.939859 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:32.026997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e00d7359-a4d2-4014-966b-c4a04086a5c5 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "DELETE /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 204 len: 0 microversion: 2.1 time: 0.124467 Jun 27 21:22:32.027841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 409/825] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:31 2022] DELETE /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:32.036478 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:32.037167 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:32.043248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.043721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.044488 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.044945 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.054386 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:32.055182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:32.061922 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.062482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.063941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.064436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.175786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.183442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cbeafb03-986f-4df7-a621-05ff009c7e90 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.151522 Jun 27 21:22:32.184006 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 417/826] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:32 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:32.197069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.204926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a6c07e3e-522f-4353-bb3d-864781cf19e2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.155602 Jun 27 21:22:32.205487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 410/827] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:32 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:32.317936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:32.318755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:32.326502 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:32.327133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:32.328072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.328514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.329284 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.329709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.333899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.334347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.335098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:32.335521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:32.465815 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.473800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2e893e3b-47a8-4df4-b2d7-f9b37e92185f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.162340 Jun 27 21:22:32.474477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 418/828] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:32 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:32.479526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.487967 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.489456 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:32.490610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9ca22c7-ae04-44f0-aa18-0fdef33b8bdd tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.170702 Jun 27 21:22:32.491196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 411/829] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:32 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:33.202247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:33.202851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:33.209791 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.210231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.210995 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.211421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.221967 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:33.222561 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:33.228886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.229861 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.230038 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.230485 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.342844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.351323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-339aef72-3c33-477c-8542-6e74c227a01e tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.153528 Jun 27 21:22:33.351935 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 419/830] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:33 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:33.361806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.370035 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-01ff190f-d4ae-41dd-a9ff-7a91ad7525c3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.151898 Jun 27 21:22:33.370604 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 412/831] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:33 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:33.494649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:33.495683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:33.503127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.503593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.504423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.504876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.510168 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:33.510842 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:33.517375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.517837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.518632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:33.519080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:33.522014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:33.644736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.652374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-51613f82-a0d1-4580-b2bb-6c80dae4d588 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.164195 Jun 27 21:22:33.652952 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 420/832] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:33 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:33.655431 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.663418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.664995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:33.666131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e002f9b4-c379-484a-b3ac-2ecadaf65ecf tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.160078 Jun 27 21:22:33.666696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 413/833] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:33 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:34.372196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:34.373241 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:34.384430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.384939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.385884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.387858 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:34.388555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:34.388825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.395643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.396119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.396866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.397311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.527804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.529485 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.535639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7bb89c13-605f-4af2-b340-307eb5cfcad6 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.169841 Jun 27 21:22:34.536330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 421/834] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:34 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:34.537053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-22adeb84-f0ee-4585-aa06-501e6b433cd9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.153862 Jun 27 21:22:34.537599 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 414/835] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:34 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:34.668637 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:34.669254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:34.675530 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.676032 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.676795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.677335 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.683652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:34.684254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:34.690403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.690838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.692202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:34.692629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:34.817934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.826590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c3117068-3914-45d1-9266-b6b86a79858f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.161824 Jun 27 21:22:34.831905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.835632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 422/836] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:34 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:34.840179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.841736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:34.842956 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ffa3060c-31ac-4ff5-b16c-41057e8b1c3a tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.163207 Jun 27 21:22:34.843544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 415/837] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:34 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:35.552884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.553492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.553690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.554290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.560262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.560711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.560818 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.561273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.561464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.561892 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.562071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.562497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.695583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:35.697666 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:35.703476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f90d9979-74aa-4ce2-84d0-dd3965f57668 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.153525 Jun 27 21:22:35.704054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 416/838] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:35.705405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-58b05e14-833c-462d-8d79-84a202bd576f tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.156439 Jun 27 21:22:35.705978 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 423/839] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:35.852621 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.853219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.859510 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.859980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.860738 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.861163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.861489 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:35.862161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:35.869893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.870421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:35.871370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:35.871876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.000965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.008963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-48c162ab-99a0-4b06-b663-095781cf5aa2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.160155 Jun 27 21:22:36.009712 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 417/840] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:36.036597 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.044780 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.046273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.047405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a6a838e6-5608-4482-9060-e765b3c72137 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.190128 Jun 27 21:22:36.047985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 424/841] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:35 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:36.727430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:36.729489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:36.730483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:36.730886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:36.738967 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.739163 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.739423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.739591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.740219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.740401 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:36.740642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.740824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:36.923594 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.936086 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f9a3d65a-2799-41d2-9f7d-8cc01282ce7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.216386 Jun 27 21:22:36.936904 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 425/842] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:36 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:36.950612 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:36.958684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c65624bd-f172-4558-8703-4395735d228a tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.238926 Jun 27 21:22:36.968589 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 418/843] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:36 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:37.028544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:37.029699 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:37.036306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.036845 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.037694 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.038124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.066234 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:37.067209 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:37.076990 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.084052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.084966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.085595 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.210498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.218125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0b009e83-3260-46a6-8ce1-9147a353037e tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.195284 Jun 27 21:22:37.218694 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 426/844] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:37 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:37.275765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.284410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.286261 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:37.287780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56ebdb0d-a4bb-445e-bbba-2b24f3dd6cc4 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.225965 Jun 27 21:22:37.289170 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 419/845] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:37 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:37.955071 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:37.956495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:37.964303 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.965248 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.966246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:37.966895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:37.986687 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:37.988579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:38.000829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.001498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.002908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.003487 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.152336 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.166279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:UPDATE=2,nova_cell1:SELECT=97,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:38.169358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e38d7034-f67d-439d-95eb-f819cacc253b tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.219130 Jun 27 21:22:38.178802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 427/846] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:37 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:38.186966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.195557 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4af4ac7f-2366-4cff-a644-87b1d309cd69 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.223297 Jun 27 21:22:38.205870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 420/847] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:37 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:38.235457 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:38.236092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:38.243076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.243510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.244378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.244805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.307793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:38.308497 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:38.315365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.315835 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.316842 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:38.317410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:38.392258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.401008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a6a55d88-325e-4ac7-af64-a0b15ac9ce7a tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.169363 Jun 27 21:22:38.401784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 428/848] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:38 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:38.479119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.488300 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.490460 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:38.492020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ec54cf03-6b46-4549-a8eb-0c035aaed0b9 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.188728 Jun 27 21:22:38.493247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 421/849] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:38 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:22:39.186300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:39.186902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:39.193525 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.193965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.194725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.195149 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.213269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:39.213995 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:39.220866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.221413 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.222166 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.222587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.340128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.348419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6d2ee06a-3c8b-438f-904c-ea2274fe5739 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.166012 Jun 27 21:22:39.348999 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 429/850] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:39 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:39.392352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.400446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ab0f7aba-b594-4857-8b7b-5d45b6287320 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.191018 Jun 27 21:22:39.401341 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 422/851] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:39 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:39.417164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:39.417976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:39.425307 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.425773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.426663 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.427131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.510558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:39.511155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:39.517187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.517760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.518506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:39.519279 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:39.583999 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.594080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b5840b4a-4d85-4802-b94a-86cd5fb7a2dc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.180807 Jun 27 21:22:39.595232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 430/852] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:39 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:39.676292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.685367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.686844 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:39.688018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f3ce82f3-d4bb-4c9e-a99f-339ed2714469 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.181370 Jun 27 21:22:39.688888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 423/853] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:39 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:22:40.365878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:40.366458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:40.373255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.373695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.374453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.374877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.420328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:40.420328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:40.425775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.426328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.427188 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.427948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.519653 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.527239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-433b7d30-8dc3-4fb3-a546-17bad4f1e8ef tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.165429 Jun 27 21:22:40.527844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 431/854] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:40 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:40.590277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.598547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-01c7eae0-8c19-4e8a-86f2-74edaf2a045e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.184264 Jun 27 21:22:40.614475 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:40.615217 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:40.617726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 424/855] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:40 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:40.623565 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.624093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.624959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.625455 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.707909 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:40.708553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:40.715124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.715564 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.716420 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.717014 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.799069 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.807742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c80042c5-8eee-4232-bc16-fccb7d65f2df tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.196810 Jun 27 21:22:40.807742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 432/856] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:40 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:40.813382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-42fcd05f-04eb-4122-9597-9e92667e0787 req-91c47512-7e47-4c27-b114-b228de465f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a3191b-7b8d-45c0-b7a7-a92591a03df0", "name": "network-vif-unplugged", "status": "completed", "tag": "0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:40.822673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-42fcd05f-04eb-4122-9597-9e92667e0787 req-91c47512-7e47-4c27-b114-b228de465f26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:40.823184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-42fcd05f-04eb-4122-9597-9e92667e0787 req-91c47512-7e47-4c27-b114-b228de465f26 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:40.836994 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-42fcd05f-04eb-4122-9597-9e92667e0787 req-91c47512-7e47-4c27-b114-b228de465f26 service nova] Creating event network-vif-unplugged:0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33 for instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 on hv-cinder-84773 Jun 27 21:22:40.844014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-42fcd05f-04eb-4122-9597-9e92667e0787 req-91c47512-7e47-4c27-b114-b228de465f26 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034794 Jun 27 21:22:40.845121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 433/857] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:40 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:40.913295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.923441 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.925428 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:40.926862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ef97779e-9371-4334-8c75-77cf27dc835b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.223563 Jun 27 21:22:40.938790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 425/858] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:40 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:22:41.544981 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.545696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.555117 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.556202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.557290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.557875 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.616522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.617131 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.624156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.624893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.625889 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.626556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.703506 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:41.716585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-43898f06-b619-4dc1-9094-c0f291b6cf4a tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.175826 Jun 27 21:22:41.726940 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 434/859] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:41 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:41.776357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:41.784476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dc840a0f-5e9f-4e66-a15a-58cdf8de1af3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.171982 Jun 27 21:22:41.785061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 426/860] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:41 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:41.825777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.826819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.834482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.835439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.836331 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.836976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.945914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:41.946506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:41.953007 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.953683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:41.954620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:41.955210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.004416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.012809 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-921c8852-7eae-4333-93ef-b17061c5ef3d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.192475 Jun 27 21:22:42.013398 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 435/861] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:41 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:42.104821 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.113196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.114683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.115856 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-34a006bf-2a61-4caf-8132-893db4ac1a79 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.173853 Jun 27 21:22:42.116407 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 427/862] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:41 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:42.736785 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:42.737576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:42.747640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.748127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.748893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.749318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.802022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:42.803225 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:42.811912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.812668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.813970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:42.814635 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:42.922987 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.930378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ec7a5f36-b2e6-45f6-bbc7-9268f46a6724 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.199672 Jun 27 21:22:42.930940 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 436/863] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:42 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:42.966468 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:42.974486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0c095965-6370-41f1-a470-6f16f61fbd80 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.176836 Jun 27 21:22:42.976658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 428/864] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:42 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:43.029683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:43.030278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:43.036492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.036927 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:43.037702 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.038379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:43.134606 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:43.135311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:43.141968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.142402 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:43.143163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.143584 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:43.293273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:43.295552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:43.308311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:43.310999 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:43.312329 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-59c74d82-458d-49c0-9618-a309c2b9039e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.181557 Jun 27 21:22:43.327849 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 429/865] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:43 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:22:43.370951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:43.378462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-34b441e9-0007-4000-8d4a-d572b16b4188 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.352772 Jun 27 21:22:43.379029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 437/866] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:43 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:43.952329 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:43.952970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:43.960312 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.960838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:43.961683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:43.962190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.000399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:44.000976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:44.008639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.009082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.009961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.010391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.156964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.165066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2102ca3c-8649-4f54-959e-fcf9b3c263a4 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.169791 Jun 27 21:22:44.165877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 438/867] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:43 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:44.330389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:44.331005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:44.337547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.337968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.338735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.339164 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.370664 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.378359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2bddef23-5569-45f6-97b7-a61ddf8a4a7d tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.432678 Jun 27 21:22:44.379116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 430/868] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:43 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:44.395575 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:44.396297 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:44.402680 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.403117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.403951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:44.404378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:44.469718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.477545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.479027 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.480242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-370d1295-6748-4508-830d-f03e65f413eb tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.153747 Jun 27 21:22:44.480788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 439/869] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:44 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:44.536547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:44.549106 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-207bfa7d-a0e5-4c39-9d4f-f6ba16aab6ff tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.156973 Jun 27 21:22:44.549905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 431/870] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:44 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:45.182797 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:45.183363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:45.190379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.190832 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.191599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.192057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.396349 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:45.396940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:45.404093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.404829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.405313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.405732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.418500 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.431383 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-81514d83-e69e-4e8a-b1ad-cbd8f8d573fa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.252397 Jun 27 21:22:45.435745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 440/871] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:45 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:45.498384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:45.498996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:45.505444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.505887 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.506654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.507082 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.557323 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.565184 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7dcf50b6-7df1-4ce4-8c80-b827562efc24 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1520 microversion: 2.1 time: 0.172880 Jun 27 21:22:45.565965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 432/872] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:45 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1520 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:45.570714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:45.571491 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:45.577785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.578217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.579021 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.579444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.710549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.715933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.718725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.720255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:45.721403 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1b5f3014-52b8-45be-9804-2c643111ca89 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.227008 Jun 27 21:22:45.721947 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 441/873] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:45 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 27 21:22:45.723720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c5d61a1c-3f09-40e8-86cd-fbd46b59e22f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.156547 Jun 27 21:22:45.724416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 433/874] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:45 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:45.726382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-30338be9-7bcb-4a7b-8267-e727fb14d24b req-969e5f3b-a4ce-4d70-9ea8-2d7593273656 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "49a3191b-7b8d-45c0-b7a7-a92591a03df0", "name": "network-vif-deleted", "tag": "0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:45.734400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-30338be9-7bcb-4a7b-8267-e727fb14d24b req-969e5f3b-a4ce-4d70-9ea8-2d7593273656 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:45.734824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-30338be9-7bcb-4a7b-8267-e727fb14d24b req-969e5f3b-a4ce-4d70-9ea8-2d7593273656 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:45.745489 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-30338be9-7bcb-4a7b-8267-e727fb14d24b req-969e5f3b-a4ce-4d70-9ea8-2d7593273656 service nova] Creating event network-vif-deleted:0e7cbdd0-3ffe-427c-864e-7b58e6e6dd33 for instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 on hv-cinder-84773 Jun 27 21:22:45.750640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-30338be9-7bcb-4a7b-8267-e727fb14d24b req-969e5f3b-a4ce-4d70-9ea8-2d7593273656 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027626 Jun 27 21:22:45.751216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 442/875] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:46.452929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:46.453866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:46.465156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.465819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.466633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.467058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.582881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:46.583756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:46.590908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.591366 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.592191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.592620 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.612377 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.621378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2fc934d8-04e4-4b62-821c-541290788d2e tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.175122 Jun 27 21:22:46.622065 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 434/876] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:46 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:46.660615 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.668050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1959d1f8-cad6-4684-8e10-2de219260973 tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1306 microversion: 2.1 time: 0.089365 Jun 27 21:22:46.668601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 443/877] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:46 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1306 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:46.743780 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:46.744243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:46.744833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:46.745295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:46.752029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.752188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.752481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.752653 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.753253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.753410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:46.753676 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.753818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:46.888917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.899424 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.900138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-518eeee0-f456-419b-91a4-231e09df46b3 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.162032 Jun 27 21:22:46.901197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 444/878] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:46 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:46.908222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.910079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:46.911246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-dc1632e0-57f1-4e15-82cf-329eb58d80ac tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.174144 Jun 27 21:22:46.912090 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 435/879] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:46 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:47.638377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.638973 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.645948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.646400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.647176 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.647651 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.683705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.684416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.690684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.690960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.691749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.692175 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.724673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.725116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.725591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lazy-loading 'fault' on Instance uuid 49a3191b-7b8d-45c0-b7a7-a92591a03df0 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:47.767213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '92c1e4ea6ab84f94a2215f8c534ca159', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9c06e827e8c44f58a2051705a46e361c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:47.774749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b56c45c3-d17d-40d8-b692-2bb6799343da tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 200 len: 1311 microversion: 2.1 time: 0.094722 Jun 27 21:22:47.775342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 436/880] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:47 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 1311 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:47.780196 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.780749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.786623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:47.786781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.787158 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.787940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.788398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.789107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:47.796030 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e2dd3e2a-1919-4631-8b02-48a5f02c9dca tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.161531 Jun 27 21:22:47.796809 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 445/881] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:47 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:47.872250 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'services' on Instance uuid 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:47.918120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.918759 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.925508 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.926053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.926910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.927348 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.953370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d255be65-a620-4ac0-b0fb-eb48bc87272f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments/d6a2b6cb-53b9-4806-b7aa-59f33f950d90" status: 202 len: 0 microversion: 2.1 time: 0.176662 Jun 27 21:22:47.954347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 437/882] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:22:47 2022] DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments/d6a2b6cb-53b9-4806-b7aa-59f33f950d90 => generated 0 bytes in 178 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:22:47.960696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:47.961476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:47.968432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.968941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:47.969806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:47.970296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.061355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:48.071511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d731ba7b-a1b1-48cb-850e-c43528cc7385 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.157277 Jun 27 21:22:48.072124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 446/883] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:47 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:48.077562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:48.078537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:48.084803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.085332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.086183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.086688 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.105932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:48.117116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:48.118742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-02abc3ae-8296-44a2-9022-6e9e3b3cb69c tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045583 Jun 27 21:22:48.119320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 447/884] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:48 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:48.119459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:48.120982 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9da39846-c28d-4cd3-a0f1-da3a1e47dd84 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.165203 Jun 27 21:22:48.121720 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 438/885] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:47 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:48.792200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:48.792831 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] [instance: 49a3191b-7b8d-45c0-b7a7-a92591a03df0] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:48.799720 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.800222 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.801734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.802181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.813022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:48.814220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:48.816660 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:48.822459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.823132 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.823561 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] HTTP exception thrown: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. Jun 27 21:22:48.824462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:48.825201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Request method failure captured: Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 HTTP/1.1 Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh5nhYV5-mHXqsRIsyeJyvLFShEA7le7yZj20PKtwqTHr_nxsNbILeRfunOZyWnZPPvc_uG7LTvfFTQR1YSmKj6USXUGVHatidMK6Gj-dJGrPYggxA_MKDQFSiurCQKrOiJzgw_ViDjG0qC86YzYOCorVo7gn0W_tmkXfD4Iq5X_c7I Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:48.825949 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/9c06e827e8c44f58a2051705a46e361c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/9c06e827e8c44f58a2051705a46e361c"}]}] Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 9c06e827e8c44f58a2051705a46e361c Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274878984 Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 92c1e4ea6ab84f94a2215f8c534ca159 Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274878984-project Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. Jun 27 21:22:48.827415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '49a3191b-7b8d-45c0-b7a7-a92591a03df0'} Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:48.828280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. Jun 27 21:22:48.829563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:48.830813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] Returning 404 to user: Instance 49a3191b-7b8d-45c0-b7a7-a92591a03df0 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:48.830813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-03d153d5-9910-4821-9145-78fe91ef69ed tempest-ServerRescueNegativeTestJSON-274878984 tempest-ServerRescueNegativeTestJSON-274878984-project] 10.222.0.27 "GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0" status: 404 len: 111 microversion: 2.1 time: 0.039552 Jun 27 21:22:48.830813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 448/886] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:48 2022] GET /compute/v2.1/servers/49a3191b-7b8d-45c0-b7a7-a92591a03df0 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:48.991283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:48.999911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-afbeb677-c0f4-43e3-9339-10e6c8ef41db tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.190637 Jun 27 21:22:49.000493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 439/887] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:48 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:22:49.088479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.089085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:49.095546 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.096019 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.096783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.097208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.131474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.132732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:49.141637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.143142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.144064 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.144573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.175451 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5e8709d9-b4c0-4f80-bf34-d74c783a145d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048843 Jun 27 21:22:49.176868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 440/888] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:49.181916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:49.182509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:49.189029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.189521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.190552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:49.191265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:49.325158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:49.333150 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-833876a3-ee7d-4cff-87ed-696652031396 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.248491 Jun 27 21:22:49.333711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 449/889] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:49.335094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:49.344191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:49.345710 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:49.346869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-150098e7-9470-41ff-a5c5-4aa66d7f325c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.168855 Jun 27 21:22:49.347467 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 441/890] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:49 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:50.017946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.019547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.028160 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.028960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.030032 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.030665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.187558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.188746 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.196313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.196815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.197853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.198339 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.240128 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1756b013-8165-440e-8bba-508b9e16be9d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056616 Jun 27 21:22:50.240845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 442/891] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:22:50.304173 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.304681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.311819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.312253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.313019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.313623 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.341853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:22:50.396366 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:50.427882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-56d7b5f1-f7f6-4c1c-9bca-4b115eb429dc tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 204 len: 0 microversion: 2.1 time: 0.127766 Jun 27 21:22:50.428695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 443/892] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:50 2022] DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:22:50.433807 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.434661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.441031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.441484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.442310 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.442743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.541955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.550572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fa955b69-cf93-4c49-a8af-3bcfa0008afa tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.537170 Jun 27 21:22:50.551246 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 450/893] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 539 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:50.556258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.557110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.563515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.564081 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.564942 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.565440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.585082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.593173 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cd672eca-4a8d-4ca7-b24b-86e268e56de4 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.162920 Jun 27 21:22:50.593375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 444/894] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:50.597968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:50.598547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:50.604602 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.605042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.605791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:50.606317 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:50.737513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.747214 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2ce8c43a-cd08-4174-b11b-807783c3fc3f tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1682 microversion: 2.1 time: 0.152835 Jun 27 21:22:50.748072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 445/895] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:50.787299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.795825 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.797629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:50.798859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b83d6413-36bc-409c-924b-699430fb07f3 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.246331 Jun 27 21:22:50.810415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 451/896] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:50 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:51.446632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-6f6e8312-7edd-4c9d-b4b7-6136efaccd44 req-58c8572c-fc64-421d-ae74-e3ba4ed907d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9fa96-14c9-46b3-a1fc-a9a1d2a99762", "name": "network-vif-plugged", "status": "completed", "tag": "d9fd079e-447c-4359-acd1-aea7c7b6d077"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:51.456826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6f6e8312-7edd-4c9d-b4b7-6136efaccd44 req-58c8572c-fc64-421d-ae74-e3ba4ed907d8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.457257 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-6f6e8312-7edd-4c9d-b4b7-6136efaccd44 req-58c8572c-fc64-421d-ae74-e3ba4ed907d8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.476990 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-6f6e8312-7edd-4c9d-b4b7-6136efaccd44 req-58c8572c-fc64-421d-ae74-e3ba4ed907d8 service nova] Creating event network-vif-plugged:d9fd079e-447c-4359-acd1-aea7c7b6d077 for instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 on hv-cinder-84773 Jun 27 21:22:51.482133 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-6f6e8312-7edd-4c9d-b4b7-6136efaccd44 req-58c8572c-fc64-421d-ae74-e3ba4ed907d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039189 Jun 27 21:22:51.482742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 446/897] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:51.567813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:51.569242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:51.575745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.576198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.577601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.578162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.620208 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:51.623045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:51.632488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.633213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.634098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.634828 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.819860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:51.827672 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-decf53bf-27b3-4714-8d2f-4f5760173844 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.222053 Jun 27 21:22:51.828592 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 447/898] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:51 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:51.834201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:51.834907 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:51.849832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.850272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.851263 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:51.851836 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:51.963110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:51.989294 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1e0a1ffc-2491-44bf-ab85-e72b68bd72b9 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.425251 Jun 27 21:22:51.999169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 452/899] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:51 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:51.999169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:51.999169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:52.015210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.016075 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.017020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.017470 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.026715 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:52.035650 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-917045c3-835a-4aae-8f74-f392240d9aeb tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1682 microversion: 2.1 time: 0.206003 Jun 27 21:22:52.045140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 448/900] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:51 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1682 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:52.346415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:52.359893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:52.362591 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:52.364767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-28fa29a2-d75c-4979-af47-f119ca155978 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.373499 Jun 27 21:22:52.365881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 453/901] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:51 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:52.846078 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:52.846747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:52.857391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.857874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:52.858679 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:52.859110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.008708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:53.010262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:53.013361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:22:53.032549 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.041110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.045776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.047556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.198059 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.205960 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d1ac1dcb-4e96-44d2-97e1-187f332f13ae tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.202863 Jun 27 21:22:53.206589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 454/902] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:53 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:53.211356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:53.212037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:53.219162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.219691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.220532 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.220967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.226321 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.234120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0dc9d7d9-ff85-4175-ae61-a7d4f8430f63 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1264 microversion: 2.1 time: 0.391990 Jun 27 21:22:53.234834 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 449/903] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:52 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1264 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:53.283339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.291287 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-80d2d3eb-2b01-4508-84c2-7c5bc3b53254 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1615 microversion: 2.1 time: 0.083540 Jun 27 21:22:53.291822 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 455/904] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:53 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1615 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:53.384194 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:53.385579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:53.392265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.393146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.394490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.395357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.514144 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-9ddf70bd-b878-49d4-94c6-caaad8c97cf7 req-85ecb892-1e52-42c1-a6e7-cc53988222ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0bfdf0f7-f64d-4f00-aa3b-ce58b327200e", "name": "network-vif-deleted", "tag": "8a5a8d43-3ba7-46cf-842d-bc561144c0b0"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:53.525763 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-9ddf70bd-b878-49d4-94c6-caaad8c97cf7 req-85ecb892-1e52-42c1-a6e7-cc53988222ce service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.526194 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-9ddf70bd-b878-49d4-94c6-caaad8c97cf7 req-85ecb892-1e52-42c1-a6e7-cc53988222ce service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.555299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-9ddf70bd-b878-49d4-94c6-caaad8c97cf7 req-85ecb892-1e52-42c1-a6e7-cc53988222ce service nova] Creating event network-vif-deleted:8a5a8d43-3ba7-46cf-842d-bc561144c0b0 for instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e on hv-cinder-84773 Jun 27 21:22:53.568913 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-9ddf70bd-b878-49d4-94c6-caaad8c97cf7 req-85ecb892-1e52-42c1-a6e7-cc53988222ce service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058546 Jun 27 21:22:53.571919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 456/905] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:53.577806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "name": "network-vif-plugged", "status": "completed", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}, {"server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "name": "network-vif-plugged", "status": "completed", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:53.591784 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:53.592812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:53.608611 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.618594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.622838 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:53.624629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1df609d8-1fd5-4d54-836f-cda72d091c1c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.244357 Jun 27 21:22:53.625681 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 450/906] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:53 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:53.627808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] Creating event network-vif-plugged:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:22:53.628526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] Creating event network-vif-plugged:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:22:53.640710 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-5ff71ab5-3b85-4b90-a631-918d54fa2f30 req-d0cb79db-bc44-4088-abf7-532f2fb6d243 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.067025 Jun 27 21:22:53.641643 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 457/907] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:53 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:22:54.222918 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.223650 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.231345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.231830 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.232622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.233200 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.252421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.253585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.273657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.274534 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.275938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.276583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.407036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.416513 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-622cbe6f-1024-45c6-bbc7-911bf686d287 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.197552 Jun 27 21:22:54.424848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 451/908] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:54.428722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.429337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.437272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.437713 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.438506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.438901 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.480020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.480459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.481114 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lazy-loading 'fault' on Instance uuid 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:22:54.488551 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.500411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dae27de0-d067-457f-abe5-faf1622d8987 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1452 microversion: 2.1 time: 0.252773 Jun 27 21:22:54.511386 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 458/909] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1452 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:54.518240 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.518844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.524848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.525292 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.526062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.526485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.536936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '30cbde26a1964f22902c24917006fb90', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b5921bd9539401d9a235ccde185632b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.545019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-28ee5813-548f-43f7-ba15-a3786a6f59b5 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 200 len: 1332 microversion: 2.1 time: 0.126466 Jun 27 21:22:54.546197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 452/910] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 1332 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:54.643079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:54.643726 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:54.667365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.667852 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.668888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:54.669123 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:54.813262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.825351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2a28ee9e-2f7c-4112-976a-1d9babefbe74 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1452 microversion: 2.1 time: 0.310964 Jun 27 21:22:54.826427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 459/911] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1452 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:54.863521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.872258 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.874673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:54.876067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6ab8149f-4ad3-467b-af68-052c5ac24a72 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.237520 Jun 27 21:22:54.877105 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 453/912] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:54 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:55.433586 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.434238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:55.443381 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.443895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.444684 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.445126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.563423 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.564668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:55.572416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.573074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.574000 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.574639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.590249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e HTTP/1.1 Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:22:55.592081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:55.593699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '0bfdf0f7-f64d-4f00-aa3b-ce58b327200e'} Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:55.594614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:55.596124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:55.597408 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:55.598708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7f8abc31-d80f-4438-8812-4566f8172bd8 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 404 len: 111 microversion: 2.1 time: 0.039124 Jun 27 21:22:55.599226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 454/913] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:55 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:55.607876 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb01c896-017b-4544-9a19-cf3b01c0ca3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '.version_select at 0x7eff561ccca0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.624867 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:55.627591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eb01c896-017b-4544-9a19-cf3b01c0ca3d tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118200545" status: 202 len: 0 microversion: 2.1 time: 0.023494 Jun 27 21:22:55.628831 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 455/914] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 27 21:22:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1118200545 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:22:55.634020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5080ca3d-2bd1-4b05-9fb5-33af72dceb01 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1576 microversion: 2.1 time: 0.204216 Jun 27 21:22:55.639667 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 460/915] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:55 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1576 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:55.894614 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:55.895212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:55.904087 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.904532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:55.905436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:55.905714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.209446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.217692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.219198 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.220401 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-882450a7-fc75-41f9-8abe-2b10db409c35 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.329790 Jun 27 21:22:56.220947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 456/916] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:55 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:56.650266 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:56.651601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:56.660710 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.661752 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.662621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:56.664408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:56.868202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:56.883263 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ecdb3021-b4c6-4444-8771-aad518d10f03 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1563 microversion: 2.1 time: 0.236678 Jun 27 21:22:56.895382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 461/917] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:56 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1563 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:22:57.238578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:57.239221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:57.250558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.253050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.258085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.381976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-269b0bd1-4e0d-40be-bb87-ec24f2fdae0b req-1f672789-3e44-4764-9871-67f05f792d59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9fa96-14c9-46b3-a1fc-a9a1d2a99762", "tag": "d9fd079e-447c-4359-acd1-aea7c7b6d077"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:22:57.390623 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-269b0bd1-4e0d-40be-bb87-ec24f2fdae0b req-1f672789-3e44-4764-9871-67f05f792d59 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.391057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-269b0bd1-4e0d-40be-bb87-ec24f2fdae0b req-1f672789-3e44-4764-9871-67f05f792d59 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.402514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-269b0bd1-4e0d-40be-bb87-ec24f2fdae0b req-1f672789-3e44-4764-9871-67f05f792d59 service nova] Creating event network-changed:d9fd079e-447c-4359-acd1-aea7c7b6d077 for instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 on hv-cinder-84773 Jun 27 21:22:57.407736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-269b0bd1-4e0d-40be-bb87-ec24f2fdae0b req-1f672789-3e44-4764-9871-67f05f792d59 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029663 Jun 27 21:22:57.408596 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 462/918] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:22:57.450897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:57.465506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:57.467280 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:57.468798 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b3ed6773-3e07-42f0-a727-f4a45b3f32f7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1731 microversion: 2.20 time: 0.234274 Jun 27 21:22:57.469460 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 457/919] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:57 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1731 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:57.899503 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:57.900101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:57.906838 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.907282 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.908103 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.908580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.921873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e HTTP/1.1 Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:57.923800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.925319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '0bfdf0f7-f64d-4f00-aa3b-ce58b327200e'} Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:57.926184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.927709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.929822 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:57.930835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a9fccc7a-9be3-4d0b-9715-f8ab63c57237 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 404 len: 111 microversion: 2.1 time: 0.035455 Jun 27 21:22:57.931534 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 463/920] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:57 2022] DELETE /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:57.939437 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:57.940104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:57.946124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.946563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.947315 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:57.947837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:57.963405 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e HTTP/1.1 Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:22:57.965031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.966591 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '0bfdf0f7-f64d-4f00-aa3b-ce58b327200e'} Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:57.967442 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. Jun 27 21:22:57.968981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:57.970271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0bfdf0f7-f64d-4f00-aa3b-ce58b327200e could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:57.970271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-100e3b89-ff9c-4268-b0f1-0875ee7dbb27 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e" status: 404 len: 111 microversion: 2.1 time: 0.030771 Jun 27 21:22:57.970271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 458/921] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:57 2022] GET /compute/v2.1/servers/0bfdf0f7-f64d-4f00-aa3b-ce58b327200e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:58.487358 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:58.487990 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:58.494402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:58.494839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.495595 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:58.496118 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:58.637983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:58.646224 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:58.647768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:22:58.648920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-534aeb8c-d0ef-4e08-91fa-e63a76fe99ee tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1718 microversion: 2.20 time: 0.165553 Jun 27 21:22:58.649511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 464/922] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:22:58 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:22:59.119533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:59.120057 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:59.127081 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.127526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.128318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.128746 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.142750 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 HTTP/1.1 Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:22:59.144319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.145866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '1da3400a-6c47-4649-a431-48cc4c3ec236'} Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:59.146647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.148056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.149498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:59.149498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3370f142-d2ed-4827-9bf1-5414cb026e66 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 404 len: 111 microversion: 2.1 time: 0.030095 Jun 27 21:22:59.149498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 459/923] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:59 2022] DELETE /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:59.154299 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:59.154919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 1da3400a-6c47-4649-a431-48cc4c3ec236] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:59.161992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.162444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.163215 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.163677 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.177290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 HTTP/1.1 Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:59.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.180376 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '1da3400a-6c47-4649-a431-48cc4c3ec236'} Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:59.181235 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. Jun 27 21:22:59.182559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.183928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 1da3400a-6c47-4649-a431-48cc4c3ec236 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:59.183928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4a86fc6f-c2b9-4e01-92dc-885ec2ae001a tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236" status: 404 len: 111 microversion: 2.1 time: 0.029874 Jun 27 21:22:59.183928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 465/924] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:59 2022] GET /compute/v2.1/servers/1da3400a-6c47-4649-a431-48cc4c3ec236 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:59.189058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:59.189545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:59.195945 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.196359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.197106 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.197523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.213866 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 HTTP/1.1 Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:22:59.215488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.217039 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '7c714031-7635-4b59-bf82-3fa3a17deb64'} Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:59.217944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.219415 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.221270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:59.221270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0dda38af-5708-4d2f-bccc-2f0ce1b27d50 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 404 len: 111 microversion: 2.1 time: 0.031594 Jun 27 21:22:59.221270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 460/925] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:22:59 2022] DELETE /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:22:59.225423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:22:59.226039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 7c714031-7635-4b59-bf82-3fa3a17deb64] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:22:59.232279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.232725 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.233488 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:22:59.233920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:22:59.247332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 HTTP/1.1 Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:22:59.248878 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.250367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '7c714031-7635-4b59-bf82-3fa3a17deb64'} Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:22:59.251226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. Jun 27 21:22:59.252510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:22:59.253739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 7c714031-7635-4b59-bf82-3fa3a17deb64 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:22:59.253739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0979ad3c-4f30-43fa-aaa3-e829296d0bde tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64" status: 404 len: 111 microversion: 2.1 time: 0.028741 Jun 27 21:22:59.253739 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 466/926] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:22:59 2022] GET /compute/v2.1/servers/7c714031-7635-4b59-bf82-3fa3a17deb64 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:23:02.506101 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:02.506649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:02.514290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.514722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.515478 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.515938 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.529578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad HTTP/1.1 Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:23:02.531086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.532634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad'} Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:02.533474 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.534893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.536649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:02.536649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-061e42d9-f50a-45fa-a112-f3946ca0ecc4 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 404 len: 111 microversion: 2.1 time: 0.031064 Jun 27 21:23:02.536649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 461/927] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:23:02 2022] DELETE /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:23:02.540836 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:02.541447 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] [instance: 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:02.548175 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.548618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.549374 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:02.549804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:02.553772 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=100 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:02.564690 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] HTTP exception thrown: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Request method failure captured: Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad HTTP/1.1 Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4WHT7sUeNSYn61QcwhL1dnSXRLYmfT-SPmytvdRFFTs8Hd7AtGEj05ERq5Jqz34xi_7kwFJmsLd1HAxku_pxvxoA_1M29rQovoG7sYIJJb-S9jUsNXYwZ92tuT1kizsu7clSv9uyn58cYWw4CPv5pUvT8Kpn4deCUhH3JCiz9W6Zw Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:23:02.566135 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/0b5921bd9539401d9a235ccde185632b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/0b5921bd9539401d9a235ccde185632b"}]}] Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 0b5921bd9539401d9a235ccde185632b Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-458039602 Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 30cbde26a1964f22902c24917006fb90 Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeNegativeTest-458039602-project Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.568108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad'} Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:02.569353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. Jun 27 21:23:02.570723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:02.572210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] Returning 404 to user: Instance 0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:02.572210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8847d452-1154-4f1c-9d1e-7fe37d1d9772 tempest-AttachVolumeNegativeTest-458039602 tempest-AttachVolumeNegativeTest-458039602-project] 10.222.0.27 "GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad" status: 404 len: 111 microversion: 2.1 time: 0.030611 Jun 27 21:23:02.572210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 467/928] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:02 2022] GET /compute/v2.1/servers/0c6ac6ec-91cf-4b8b-931d-c0a85bf62dad => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:23:37.130690 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:37.132209 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=80 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:37.136891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:37.138158 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:37.153765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.160392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.162202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.166823 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.252646 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c8c44f2f-79f7-4ed3-82a7-7f52fe923c04 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.122773 Jun 27 21:23:37.258691 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 462/929] 10.222.0.27 () {60 vars in 1342 bytes} [Mon Jun 27 21:23:37 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2/os-volume_attachments => generated 25 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:37.356384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:37.357604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:37.364912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=27 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:37.365966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:37.368681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.369595 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.370676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.371322 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.408724 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:23:37.595310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-da972265-e4d8-4edb-a6d6-c27f95ad76c7 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 204 len: 0 microversion: 2.20 time: 0.242749 Jun 27 21:23:37.605953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:37.606743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:37.611732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 468/930] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 27 21:23:37 2022] DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:23:37.614689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.615380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.616498 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:37.617265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:37.799004 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:37.811174 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:37.812784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:37.814054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4a04864f-e7c5-4b5f-9d3c-a28335287f1f tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.213172 Jun 27 21:23:37.827793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 463/931] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:37 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:23:38.834599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:38.835300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:38.842566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:38.845352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:38.846216 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:38.846657 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:39.118531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:39.135723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:39.143480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:39.162871 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-11c2e6bb-cf6f-4d4a-99fc-0af4b7dbb4b6 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1724 microversion: 2.20 time: 0.332336 Jun 27 21:23:39.166051 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 469/932] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:38 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1724 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:23:40.183686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:40.184320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:40.191348 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:40.192189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:40.193111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:40.193749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:40.285590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:40.334271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:40.336023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:40.337357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3da0e7bf-0c1e-4548-a21f-4b39d2dab2c8 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1656 microversion: 2.20 time: 0.158576 Jun 27 21:23:40.341840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 464/933] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:40 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1656 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:23:40.388812 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-d02dfe29-047c-4803-9e0f-4f777072d753 req-9b13d4bf-f1d4-4033-8eec-49a1ec84cd0f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f053f1bf-afc5-418f-b4b7-1adf492ee9a2", "name": "network-vif-deleted", "tag": "6dc94873-d323-45af-ae08-f72b9a871f11"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:40.422735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-d02dfe29-047c-4803-9e0f-4f777072d753 req-9b13d4bf-f1d4-4033-8eec-49a1ec84cd0f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:40.424800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-d02dfe29-047c-4803-9e0f-4f777072d753 req-9b13d4bf-f1d4-4033-8eec-49a1ec84cd0f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:40.454976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-d02dfe29-047c-4803-9e0f-4f777072d753 req-9b13d4bf-f1d4-4033-8eec-49a1ec84cd0f service nova] Creating event network-vif-deleted:6dc94873-d323-45af-ae08-f72b9a871f11 for instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 on hv-cinder-84773 Jun 27 21:23:40.470409 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-d02dfe29-047c-4803-9e0f-4f777072d753 req-9b13d4bf-f1d4-4033-8eec-49a1ec84cd0f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088977 Jun 27 21:23:40.479437 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 470/934] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:41.358617 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:41.359222 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:41.366213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:41.366651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:41.367407 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:41.367861 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:41.407470 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:41.407935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:41.408522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lazy-loading 'fault' on Instance uuid f053f1bf-afc5-418f-b4b7-1adf492ee9a2 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:23:41.455519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:41.475040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:41.477185 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:41.481974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2fbb8d7f-6179-4771-86f7-247081e6799c tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1372 microversion: 2.20 time: 0.126940 Jun 27 21:23:41.484071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 465/935] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:41 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1372 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:23:42.501820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:42.503573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:42.510485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:42.510959 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:42.511762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:42.512198 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:42.547398 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:42.547806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:42.548244 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lazy-loading 'fault' on Instance uuid f053f1bf-afc5-418f-b4b7-1adf492ee9a2 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:23:42.603664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:42.611996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:42.613522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '74b2295521bc45509ef6b68c1885ac6e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6b75fb163caa47cd9b72e047e9e050e2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:42.614654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-57d18b3f-9919-4585-b88c-6768fd74c503 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 200 len: 1372 microversion: 2.20 time: 0.117661 Jun 27 21:23:42.615196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 471/936] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:42 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 1372 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 27 21:23:43.637281 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:43.638540 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:43.646480 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:43.647161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:43.648118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:43.648827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:43.664903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 HTTP/1.1 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:23:43.666668 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:43.668461 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f053f1bf-afc5-418f-b4b7-1adf492ee9a2'} Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:43.669388 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:43.670881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:43.673369 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:43.674476 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eec89a2c-96e7-4db7-83f2-0819d92a042d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 404 len: 111 microversion: 2.20 time: 0.045976 Jun 27 21:23:43.675562 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 466/937] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:43 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 27 21:23:43.684934 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2caf9d8a-540c-440e-86b1-1e4aecd2922e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '.version_select at 0x7eff55981280>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:43.713496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2caf9d8a-540c-440e-86b1-1e4aecd2922e tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010850591" status: 204 len: 0 microversion: 2.20 time: 0.032961 Jun 27 21:23:43.714511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 472/938] 10.222.0.27 () {60 vars in 1261 bytes} [Mon Jun 27 21:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1010850591 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 27 21:23:44.414219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c3163b6c-3d1b-43e2-b33a-206a4b5cb63f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'create', calling method: .version_select at 0x7eff561ccdc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1616978358", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDm5GByoOF8v07NnDXR+5crUQ8eNAaVuS/noKh/mv+oGACj6cgZF8hiEMhkUrBvBu6hYiQJWZ3plQD1OBf9q57EQhJnbJ2KNbqKOlGXdj9Qt21HFAHJe8TT/blkqKGvVqA=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:44.428846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c3163b6c-3d1b-43e2-b33a-206a4b5cb63f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Getting quotas for project 61525140325a4b14aa10df2b64efa5cd. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:23:44.432886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-c3163b6c-3d1b-43e2-b33a-206a4b5cb63f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Getting quotas for user 19e54ac48c1943b0999baeaad67a0e11 and project 61525140325a4b14aa10df2b64efa5cd. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:23:44.456706 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c3163b6c-3d1b-43e2-b33a-206a4b5cb63f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.046571 Jun 27 21:23:44.457294 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 467/939] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:23:44 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:44.568961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1189685808", "imageRef": "db446b1c-9060-4f88-a180-856785e391be", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1616978358", "networks": [{"uuid": "a6c9c19c-8728-466f-8f7e-cb5131878c1f"}]}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:44.622902 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] validate_networks() for [('a6c9c19c-8728-466f-8f7e-cb5131878c1f', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:23:45.114640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:23:45.115257 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:23:45.115514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:23:45.115948 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:23:45.116353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:23:45.125573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.126233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.127147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.127835 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.145313 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Getting quotas for project 61525140325a4b14aa10df2b64efa5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:23:45.149946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Getting quotas for user 19e54ac48c1943b0999baeaad67a0e11 and project 61525140325a4b14aa10df2b64efa5cd. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:23:45.160932 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:23:45.163166 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='db446b1c-9060-4f88-a180-856785e391be',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:23:45.208522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-77e841d1-b815-435a-b654-7c441ec87b00 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.645884 Jun 27 21:23:45.209162 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 473/940] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:23:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 647 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:23:45.219481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3c44e876-fbcf-4554-8e69-24ac3af32426 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:45.220291 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3c44e876-fbcf-4554-8e69-24ac3af32426 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:45.282903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3c44e876-fbcf-4554-8e69-24ac3af32426 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:45.291863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3c44e876-fbcf-4554-8e69-24ac3af32426 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1259 microversion: 2.1 time: 0.076832 Jun 27 21:23:45.294141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 468/941] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:45 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1259 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:45.553120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:45.553688 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:45.560040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.560608 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.561341 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.561773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.576607 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 HTTP/1.1 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:23:45.578340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.580390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'f053f1bf-afc5-418f-b4b7-1adf492ee9a2'} Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:45.581909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.585338 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.588247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:45.588247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bfd595e0-9d4e-46aa-8f91-e535e0a3de9d tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 404 len: 111 microversion: 2.20 time: 0.030735 Jun 27 21:23:45.588247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 474/942] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 27 21:23:45 2022] DELETE /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:23:45.590541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:45.591490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: f053f1bf-afc5-418f-b4b7-1adf492ee9a2] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:45.598702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.599018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.600000 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:45.600421 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:45.617226 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 HTTP/1.1 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:23:45.618891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.621899 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f053f1bf-afc5-418f-b4b7-1adf492ee9a2'} Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:45.623629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. Jun 27 21:23:45.629757 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:45.632071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance f053f1bf-afc5-418f-b4b7-1adf492ee9a2 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:45.632071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0342c813-a26b-4e97-b097-47f062644075 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2" status: 404 len: 111 microversion: 2.20 time: 0.034166 Jun 27 21:23:45.632071 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 469/943] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:45 2022] GET /compute/v2.1/servers/f053f1bf-afc5-418f-b4b7-1adf492ee9a2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:23:46.310708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:46.311403 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:46.318066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.318534 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.319332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.319806 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.403524 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:46.413471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-8bcc91b4-c3b1-4492-86f3-0c8cac628624 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1319 microversion: 2.1 time: 0.106519 Jun 27 21:23:46.414112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 475/944] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:46 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1319 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:46.780770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:46.781790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:46.795696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.799811 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.801754 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.802191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.818120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 HTTP/1.1 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:23:46.820030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.821649 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '07c8bb15-47a8-49ca-b240-c97ed0e24a43'} Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:46.823971 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.825416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.826891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:46.826891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f339f3c5-d6da-4675-a9ed-6b74f7def81b tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 404 len: 111 microversion: 2.20 time: 0.054904 Jun 27 21:23:46.826891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 470/945] 10.222.0.27 () {60 vars in 1279 bytes} [Mon Jun 27 21:23:46 2022] DELETE /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:23:46.839083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:46.839910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] [instance: 07c8bb15-47a8-49ca-b240-c97ed0e24a43] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:46.846337 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.846790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.847756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:46.848335 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:46.864964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] HTTP exception thrown: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Request method failure captured: Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 HTTP/1.1 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh4UY3pWohGvxnO3ob7unJEfnsPdGqV5IkgDG4vYu-9wXR2xMV_uyWKduCsGrdrfvfPS9Lnm0vH6OsEhPe9b9Zbyi4YHE7ilw0XsA8a7e4A-jqsvpQgPqYzwOybOnCx5knD-rKTjMfv5sC4loNzXiKVg7uN150yCdRKEgtAUgY2TqIE Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Openstack-Nova-Api-Version: 2.20 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:23:46.866583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/6b75fb163caa47cd9b72e047e9e050e2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/6b75fb163caa47cd9b72e047e9e050e2"}]}] Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 6b75fb163caa47cd9b72e047e9e050e2 Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1110675240 Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 74b2295521bc45509ef6b68c1885ac6e Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1110675240-project Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.868370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '07c8bb15-47a8-49ca-b240-c97ed0e24a43'} Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:23:46.869330 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. Jun 27 21:23:46.871138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:23:46.872665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] Returning 404 to user: Instance 07c8bb15-47a8-49ca-b240-c97ed0e24a43 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:23:46.872665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5d873a53-9317-413b-b5ff-b6e827b22ce2 tempest-AttachVolumeShelveTestJSON-1110675240 tempest-AttachVolumeShelveTestJSON-1110675240-project] 10.222.0.27 "GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43" status: 404 len: 111 microversion: 2.20 time: 0.033906 Jun 27 21:23:46.872665 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 476/946] 10.222.0.27 () {60 vars in 1276 bytes} [Mon Jun 27 21:23:46 2022] GET /compute/v2.1/servers/07c8bb15-47a8-49ca-b240-c97ed0e24a43 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 27 21:23:47.435174 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:47.436427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:47.444387 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:47.445080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:47.446414 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:47.447017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:47.769741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:47.783265 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a7ecd5b4-dfbe-4d03-abb9-d5a6961cf83e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.353623 Jun 27 21:23:47.793696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 471/947] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:47 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:48.803992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:48.805661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:48.826742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:48.827555 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:48.828782 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:48.829531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:49.106648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:49.125928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1746700c-44a3-42ce-a7ea-877f361d46d3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.325700 Jun 27 21:23:49.138168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 477/948] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:48 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:50.144719 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:50.146278 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:50.161680 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:50.162391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:50.165201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:50.165643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:50.435993 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:50.459054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4ccb734e-d197-4d09-8ee3-72f50baed926 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.315349 Jun 27 21:23:50.460353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 472/949] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:50 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:51.480907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:51.482578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:51.491247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:51.491715 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:51.492548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:51.492965 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:51.761889 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:51.780263 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-43b5dee5-70ce-4b54-bfd1-f6be67419463 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.304303 Jun 27 21:23:51.787961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 478/950] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:51 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:52.799980 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:52.800590 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:52.807929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:52.808625 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:52.809583 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:52.810168 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:53.044907 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:53.054512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ebb7e828-aa8d-4142-9ffb-f924dbeb2bdd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.258055 Jun 27 21:23:53.056092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 473/951] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:52 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:54.077239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:54.077869 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:54.091250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:54.092074 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:54.093247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:54.093986 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:54.263210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:54.275793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f57c5ef6-345e-4ed9-8a5b-709be8375673 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.202323 Jun 27 21:23:54.276857 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 479/952] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:54 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:55.295456 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:55.297437 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:55.300322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:55.307856 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:55.308581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:55.309770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:55.310360 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:55.451122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:55.458929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-fde58bd4-8b5c-4c35-a09e-9b4ab4d297cc tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.168697 Jun 27 21:23:55.459545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 474/953] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:55 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:56.476356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:56.477025 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:56.485279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:56.488155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:23:56.490851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:56.493500 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:56.496849 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:56.497454 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:56.509819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-d7bdfdb0-0507-464b-a3c7-3ce013878e17 req-a5c84a0b-bbd9-4b69-81e4-505260c56416 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:56.523953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d7bdfdb0-0507-464b-a3c7-3ce013878e17 req-a5c84a0b-bbd9-4b69-81e4-505260c56416 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:56.528716 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-d7bdfdb0-0507-464b-a3c7-3ce013878e17 req-a5c84a0b-bbd9-4b69-81e4-505260c56416 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:56.544426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-d7bdfdb0-0507-464b-a3c7-3ce013878e17 req-a5c84a0b-bbd9-4b69-81e4-505260c56416 service nova] Creating event network-changed:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:23:56.550052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-d7bdfdb0-0507-464b-a3c7-3ce013878e17 req-a5c84a0b-bbd9-4b69-81e4-505260c56416 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044883 Jun 27 21:23:56.551378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 475/954] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:23:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:23:56.667218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:56.679996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b57c680c-d3f8-49db-b0e9-f57b538e7765 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.207097 Jun 27 21:23:56.681252 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 480/955] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:56 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:57.698503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:57.699467 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:57.706105 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:57.706810 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:57.707827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:57.708375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:57.929902 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:57.938769 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6f804be9-2d93-4613-b011-bf317a1b1106 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.245102 Jun 27 21:23:57.939439 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 476/956] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:57 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:23:58.548610 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-423e7292-6918-4359-b5de-c3f39162da9a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: .version_select at 0x7eff55a94040>, body: {"keypair": {"name": "tempest-keypair-147597308", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBSrpFhNWur60D+nFh2UcZPSj83K4xN9Ffi7ujD3NjT+GBayQHA1efDfBbo6O24itv7hAcjLRVCkZayCXaaYSxl0tFqmCbk6M/XF8nec0UgPmHuc5U0KQKHxQZsiuxFouQ=="}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:23:58.562743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-423e7292-6918-4359-b5de-c3f39162da9a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for project 412630dcb5ff4402983a02b249583995. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:23:58.567048 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-423e7292-6918-4359-b5de-c3f39162da9a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for user 6eb164ecd85f498f9c3b3aabe90dc054 and project 412630dcb5ff4402983a02b249583995. Resources: {'key_pairs'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:23:58.590339 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-423e7292-6918-4359-b5de-c3f39162da9a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.165324 Jun 27 21:23:58.591020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 481/957] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:23:58 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:23:58.955942 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:23:58.956563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:23:58.966658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:58.967052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:58.968204 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:23:58.968751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:23:59.210507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:23:59.228624 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-756055c2-869e-4b65-9cbb-da3fb9c633f3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.276365 Jun 27 21:23:59.230043 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 477/958] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:23:58 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:00.030516 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-583487432", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "764b886e-d7e2-4f36-a72e-1bbb767ce292"}], "security_groups": [{"name": "tempest-securitygroup--377212259"}], "key_name": "tempest-keypair-147597308", "user_data": "}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:00.207037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] validate_networks() for [('764b886e-d7e2-4f36-a72e-1bbb767ce292', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:24:00.246119 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:00.246758 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:00.261429 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:00.262059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:00.263017 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:00.263686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:00.463438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:00.472701 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-25d4a19b-8558-4f3f-8f17-958a6317b456 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.230371 Jun 27 21:24:00.473896 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 478/959] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:00 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:00.718288 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:24:00.718728 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:24:00.719203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:24:00.719671 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:24:00.720328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:24:00.730458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:00.731181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:00.732177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:00.734726 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:00.755342 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for project 412630dcb5ff4402983a02b249583995. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:00.759711 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for user 6eb164ecd85f498f9c3b3aabe90dc054 and project 412630dcb5ff4402983a02b249583995. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:00.771266 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:24:00.773819 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:24:00.836723 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fe686eeb-a811-478a-8f98-911f8f1ea379 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.810213 Jun 27 21:24:00.838714 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 482/960] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:24:00 2022] POST /compute/v2.1/servers => generated 401 bytes in 813 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:24:00.849587 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aa82ea92-7d85-4e37-9b80-3242d7fcf3c5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:00.850209 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aa82ea92-7d85-4e37-9b80-3242d7fcf3c5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:00.951965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aa82ea92-7d85-4e37-9b80-3242d7fcf3c5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:00.959507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aa82ea92-7d85-4e37-9b80-3242d7fcf3c5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1236 microversion: 2.1 time: 0.114321 Jun 27 21:24:00.962061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 479/961] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:00 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1236 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:01.495192 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:01.495986 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:01.505998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:01.506580 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:01.508704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:01.509205 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:01.694941 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:01.706654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-53385e08-0c05-48b6-bbed-559fb1004916 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.217999 Jun 27 21:24:01.707233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 483/962] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:01 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:01.984730 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:01.985333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:01.998953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:01.999390 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:02.000190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:02.000610 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:02.098427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:02.107526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9a01ad1-994c-457a-86a0-20981b120262 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1288 microversion: 2.1 time: 0.127174 Jun 27 21:24:02.108175 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 480/963] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:01 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1288 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:02.723695 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:02.724956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:02.732608 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:02.733076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:02.733879 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:02.734301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:02.930856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:02.951169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5c7fd5d6-9045-4d93-9d08-0d5fee2bb8cd tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.231493 Jun 27 21:24:02.952063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 484/964] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:02 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:03.126057 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:03.126954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:03.146262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:03.146785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:03.147542 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:03.147997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:03.377104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:03.400632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0320920b-0618-49bc-9bd9-a36c054f1f82 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.278967 Jun 27 21:24:03.402434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 481/965] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:03 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:03.815564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-3da9b30b-82e4-418e-be21-9fc5eda6a8fa req-58ee845c-7b7b-4f6e-9272-5a6755b67843 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8785309-a893-4621-abff-634c21f4cb12", "tag": "a9f64a51-ebfd-4ad5-82b2-59817c27b136"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:03.825786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3da9b30b-82e4-418e-be21-9fc5eda6a8fa req-58ee845c-7b7b-4f6e-9272-5a6755b67843 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:03.826336 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-3da9b30b-82e4-418e-be21-9fc5eda6a8fa req-58ee845c-7b7b-4f6e-9272-5a6755b67843 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:03.843521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-3da9b30b-82e4-418e-be21-9fc5eda6a8fa req-58ee845c-7b7b-4f6e-9272-5a6755b67843 service nova] Creating event network-changed:a9f64a51-ebfd-4ad5-82b2-59817c27b136 for instance c8785309-a893-4621-abff-634c21f4cb12 on hv-cinder-84773 Jun 27 21:24:03.848670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-3da9b30b-82e4-418e-be21-9fc5eda6a8fa req-58ee845c-7b7b-4f6e-9272-5a6755b67843 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036844 Jun 27 21:24:03.849741 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 485/966] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:03.968450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:03.969157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:03.975307 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:03.975772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:03.976549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:03.977144 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:04.103961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:04.111960 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e77a9b18-3acd-4cb2-8a18-bb8431f09279 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.147368 Jun 27 21:24:04.112550 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 482/967] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:03 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:04.422540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:04.423700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:04.434296 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:04.435081 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:04.436411 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:04.437132 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:04.571969 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:04.582285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f57b0fd9-68c8-4adf-8e28-a0c4e875bbd5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.166764 Jun 27 21:24:04.582855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 486/968] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:04 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:05.133745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:05.134370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:05.141784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:05.142245 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:05.143033 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:05.143479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:05.281546 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:05.285142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:05.289940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-25656c49-e2f3-405a-a52e-c6addc003b23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.162536 Jun 27 21:24:05.290484 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 483/969] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:05 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:05.608718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:05.609679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:05.619377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:05.619865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:05.620632 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:05.621066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:05.754986 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:05.762912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-908f0bf4-a66f-4e30-a3ab-e8a4469ad20d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.160713 Jun 27 21:24:05.763484 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 487/970] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:05 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:06.306404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:06.307141 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:06.314452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:06.314885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:06.315648 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:06.316076 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:06.452018 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:06.463160 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cbbf9017-be88-4245-849f-ae54c04b324e tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.160750 Jun 27 21:24:06.463764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 484/971] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:06 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:06.780258 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:06.780931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:06.788372 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:06.788954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:06.789712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:06.790145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:06.808764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:06.975112 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:06.982859 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4bacb40b-0fb7-4e29-af5f-3cd1a419bd24 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.206475 Jun 27 21:24:06.983435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 488/972] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:06 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:07.481697 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:07.482253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:07.484643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=62,nova_api:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:07.490459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:07.490893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:07.491678 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:07.492103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:07.630870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:07.641229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-00dacc6f-18d6-4f73-bf7d-049be6cec60f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.163483 Jun 27 21:24:07.641767 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 485/973] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:07 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:08.000269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:08.000877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:08.003170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=86,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=7 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:08.008729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:08.009196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:08.010004 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:08.010444 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:08.151531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:08.160760 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-58c67ea8-6815-43bd-b132-1e845022ad98 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.164899 Jun 27 21:24:08.161456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 489/974] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:07 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:08.557190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-62fdbc98-1fa0-41a0-a2e0-bc7954da1d4b req-cce606b5-ea58-4440-9201-d10f282b0ffb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "name": "network-vif-plugged", "status": "completed", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:08.566122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-62fdbc98-1fa0-41a0-a2e0-bc7954da1d4b req-cce606b5-ea58-4440-9201-d10f282b0ffb service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:08.566486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-62fdbc98-1fa0-41a0-a2e0-bc7954da1d4b req-cce606b5-ea58-4440-9201-d10f282b0ffb service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:08.577977 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-62fdbc98-1fa0-41a0-a2e0-bc7954da1d4b req-cce606b5-ea58-4440-9201-d10f282b0ffb service nova] Creating event network-vif-plugged:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:24:08.582953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-62fdbc98-1fa0-41a0-a2e0-bc7954da1d4b req-cce606b5-ea58-4440-9201-d10f282b0ffb service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029580 Jun 27 21:24:08.583545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 486/975] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:08.660120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:08.660759 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:08.666813 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:08.667286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:08.668080 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:08.668522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:08.846788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:08.854958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-56d90af1-4260-4b2a-8edd-fc1de195e7ce tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.199736 Jun 27 21:24:08.855533 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 490/976] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:08 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:09.181791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:09.182544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:09.190184 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:09.190699 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:09.191585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:09.192129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:09.334869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:09.342535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-1e62ccf0-0b93-4c07-a52b-a428e45b5d34 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.167066 Jun 27 21:24:09.343097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 487/977] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:09 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:09.872357 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:09.872974 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:09.880504 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:09.880957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:09.881747 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:09.882188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:10.014887 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:10.022592 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a1edfa92-997f-4ae5-86db-e690c5775917 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1359 microversion: 2.1 time: 0.154307 Jun 27 21:24:10.023199 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 491/978] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:09 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:10.362035 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:10.362636 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:10.370749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:10.371189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:10.371976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:10.372409 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:10.502517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:10.509981 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-35c76c85-e38c-46ec-9188-a01910534b27 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.151695 Jun 27 21:24:10.510544 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 488/979] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:10 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:10.597694 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-0ca49e63-2663-40a8-9a9e-9decccc1fdd7 req-d46fefce-e9bc-4f5b-b5a7-beba1a43bc14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8785309-a893-4621-abff-634c21f4cb12", "name": "network-vif-plugged", "status": "completed", "tag": "a9f64a51-ebfd-4ad5-82b2-59817c27b136"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:10.605976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-0ca49e63-2663-40a8-9a9e-9decccc1fdd7 req-d46fefce-e9bc-4f5b-b5a7-beba1a43bc14 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:10.606408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-0ca49e63-2663-40a8-9a9e-9decccc1fdd7 req-d46fefce-e9bc-4f5b-b5a7-beba1a43bc14 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:10.624476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-0ca49e63-2663-40a8-9a9e-9decccc1fdd7 req-d46fefce-e9bc-4f5b-b5a7-beba1a43bc14 service nova] Creating event network-vif-plugged:a9f64a51-ebfd-4ad5-82b2-59817c27b136 for instance c8785309-a893-4621-abff-634c21f4cb12 on hv-cinder-84773 Jun 27 21:24:10.630060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-0ca49e63-2663-40a8-9a9e-9decccc1fdd7 req-d46fefce-e9bc-4f5b-b5a7-beba1a43bc14 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036103 Jun 27 21:24:10.630732 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 492/980] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:11.044260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:11.045314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:11.047891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:11.054394 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.054963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.055853 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.056395 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.199479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:11.207157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-538f2493-3d29-4700-b096-0a5dc615f99d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1549 microversion: 2.1 time: 0.166959 Jun 27 21:24:11.207738 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 489/981] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:11 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1549 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:11.220890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:11.221680 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=10 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:11.226390 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:11.227184 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:11.234280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.234718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.235467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.235920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.369691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:11.379999 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-734c0312-c70a-4b4b-8446-01c1f782dae3 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1549 microversion: 2.1 time: 0.159975 Jun 27 21:24:11.380798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 493/982] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:11 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:11.401915 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:11.405296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:11.406049 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Searching by: {'deleted': False, 'project_id': '61525140325a4b14aa10df2b64efa5cd'} {{(pid=117893) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 27 21:24:11.413156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.413620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.414391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.414781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.504377 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.multi_cell_list [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117893) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 27 21:24:11.526499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:11.527212 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:11.535988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.536429 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.537230 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.537660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.599098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f9de4ba8-2a11-41ff-a59d-0924ca77e3d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201069 Jun 27 21:24:11.599969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 490/983] 10.222.0.27 () {58 vars in 1124 bytes} [Mon Jun 27 21:24:11 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:24:11.609954 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:11.610526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:11.616490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.616934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.617685 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:11.618087 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:11.665482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:11.672929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7821723c-f0ad-49ac-bf86-551acf2b4dbf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.150452 Jun 27 21:24:11.673485 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 494/984] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:11 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:11.742791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:11.750672 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-67a11e80-452c-4a1d-82ba-200b2de50e85 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1549 microversion: 2.1 time: 0.144482 Jun 27 21:24:11.751249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 491/985] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:11 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1549 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:24:12.689617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:12.690196 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:12.697371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:12.697816 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:12.698576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:12.699003 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:12.857877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:12.867328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-433943d4-2546-4a2f-bc91-545fe4f8b1e0 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1361 microversion: 2.1 time: 0.181481 Jun 27 21:24:12.869133 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 495/986] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:12 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1361 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:13.291135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "892877b1-2900-4ebc-a560-47dd723155d0"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:13.292287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:13.300456 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:13.300902 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:13.301694 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:13.302189 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:13.574117 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4bf55d93-3c26-43ce-a329-20cc2cd53e23 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286510 Jun 27 21:24:13.574932 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 492/987] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:24:13 2022] POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:13.889421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:13.890023 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:13.898456 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:13.898891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:13.899700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:13.900124 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:14.042193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:14.051181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5a4eb5b7-615d-40d6-842a-12371a38bd06 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1546 microversion: 2.1 time: 0.165699 Jun 27 21:24:14.051816 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 496/988] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:13 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1546 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:14.068695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:14.069267 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:14.076042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:14.076483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:14.077236 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:14.077661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:14.160459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c28e3ee6-c6bb-480c-a76d-4f6cefc3d1c8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096475 Jun 27 21:24:14.161063 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 493/989] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:24:14 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:15.185950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-c35cd684-2e6e-4870-9d2f-b24aaddc9cb6 req-231fc845-a777-4196-9a20-9b477fdd0cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c8785309-a893-4621-abff-634c21f4cb12", "tag": "a9f64a51-ebfd-4ad5-82b2-59817c27b136"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:15.194886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c35cd684-2e6e-4870-9d2f-b24aaddc9cb6 req-231fc845-a777-4196-9a20-9b477fdd0cff service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:15.195328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c35cd684-2e6e-4870-9d2f-b24aaddc9cb6 req-231fc845-a777-4196-9a20-9b477fdd0cff service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:15.206480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-c35cd684-2e6e-4870-9d2f-b24aaddc9cb6 req-231fc845-a777-4196-9a20-9b477fdd0cff service nova] Creating event network-changed:a9f64a51-ebfd-4ad5-82b2-59817c27b136 for instance c8785309-a893-4621-abff-634c21f4cb12 on hv-cinder-84773 Jun 27 21:24:15.211426 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-c35cd684-2e6e-4870-9d2f-b24aaddc9cb6 req-231fc845-a777-4196-9a20-9b477fdd0cff service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029104 Jun 27 21:24:15.212062 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 497/990] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:17.871069 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-da9fc125-ecd6-4086-b863-9bf2241eb77e req-329d3981-a9cb-4896-bc08-6ae0cafedb76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:17.873061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:17.874652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:17.880755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-da9fc125-ecd6-4086-b863-9bf2241eb77e req-329d3981-a9cb-4896-bc08-6ae0cafedb76 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:17.881166 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:17.881301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-da9fc125-ecd6-4086-b863-9bf2241eb77e req-329d3981-a9cb-4896-bc08-6ae0cafedb76 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:17.881988 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:17.882546 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:17.882976 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:17.893369 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-da9fc125-ecd6-4086-b863-9bf2241eb77e req-329d3981-a9cb-4896-bc08-6ae0cafedb76 service nova] Creating event network-changed:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:24:17.898561 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-da9fc125-ecd6-4086-b863-9bf2241eb77e req-329d3981-a9cb-4896-bc08-6ae0cafedb76 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032489 Jun 27 21:24:17.902547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 498/991] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:17.910943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:24:18.144218 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5080ce08-1951-443d-a47a-dcd8e103c3cb tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 204 len: 0 microversion: 2.1 time: 0.280320 Jun 27 21:24:18.145356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 494/992] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:24:17 2022] DELETE /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:24:18.155844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:18.156538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:18.163013 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:18.163445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:18.164229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:18.164654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:18.304284 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:18.312208 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6ef9cfd0-b8e6-48cd-9657-2ee3213cfd28 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.161703 Jun 27 21:24:18.312796 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 499/993] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:18 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:19.334890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:19.336067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:19.347113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:19.347898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:19.349103 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:19.349842 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:19.486973 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:19.494661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e326d946-26fe-43e7-9706-4306f30fecd2 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.166984 Jun 27 21:24:19.495205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 495/994] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:19 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:20.512548 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:20.513108 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:20.520064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:20.520514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:20.521310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:20.521786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:20.670157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:20.677973 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-703685ad-2dc6-418f-bbd7-58b14caeecfe tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1569 microversion: 2.1 time: 0.169531 Jun 27 21:24:20.678767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 500/995] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:20 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1569 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:21.174642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:21.175266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:21.182539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:21.182966 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:21.183812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:21.184230 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:21.331126 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-8f4c14c7-e2ec-455b-bf3e-126aa7618af0 req-cfb23cc6-a423-4a27-8ab7-cb87b5d481d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f815a1a9-fea2-4c2a-ac39-8bf72e05d970", "name": "network-vif-deleted", "tag": "cb2acb1f-3617-4954-94f9-5afd027ffe47"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:21.341050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-8f4c14c7-e2ec-455b-bf3e-126aa7618af0 req-cfb23cc6-a423-4a27-8ab7-cb87b5d481d8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:21.341467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-8f4c14c7-e2ec-455b-bf3e-126aa7618af0 req-cfb23cc6-a423-4a27-8ab7-cb87b5d481d8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:21.355834 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-8f4c14c7-e2ec-455b-bf3e-126aa7618af0 req-cfb23cc6-a423-4a27-8ab7-cb87b5d481d8 service nova] Creating event network-vif-deleted:cb2acb1f-3617-4954-94f9-5afd027ffe47 for instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 on hv-cinder-84773 Jun 27 21:24:21.361366 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-8f4c14c7-e2ec-455b-bf3e-126aa7618af0 req-cfb23cc6-a423-4a27-8ab7-cb87b5d481d8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033903 Jun 27 21:24:21.362345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 501/996] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:21.377911 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:21.386012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aa1db3ec-3b5e-40c2-9e32-e6226fa5c5c2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1595 microversion: 2.1 time: 0.215257 Jun 27 21:24:21.386768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 496/997] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:21 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1595 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:21.695686 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:21.696379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:21.704220 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:21.704672 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:21.705438 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:21.705985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:21.775318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4f9b08c0c7fd4d2e957afcefca500751', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '17dea7e9f26c4b74a10d5e00a395fbd7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:21.783378 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fd500fa8-38bd-4f2c-a564-e54ebecb506d tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 200 len: 1219 microversion: 2.1 time: 0.092089 Jun 27 21:24:21.783988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 502/998] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:21 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:22.800500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:22.801201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] [instance: f815a1a9-fea2-4c2a-ac39-8bf72e05d970] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:22.803292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:22.809290 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:22.809735 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:22.810508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:22.810962 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:22.825491 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] HTTP exception thrown: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Request method failure captured: Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 HTTP/1.1 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh6ipxcBhVmAlGPi063cAxuQxU6TmcJpjJXeAGHwPX4dX0JPn9r7YfTpTpiRnmf1uHDm2i8K0OGzY-J2kawycDwxEeukpCoXbNtw_l-oF-MP24Ale5MccL4syb9ixGT15CCCo9wVCZMLbGs7p1O_IdyPp_5hV502BqN1ibICDbvr6xc Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 17dea7e9f26c4b74a10d5e00a395fbd7 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestShelveInstance-50341482 Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:24:22.827391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_17dea7e9f26c4b74a10d5e00a395fbd7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17dea7e9f26c4b74a10d5e00a395fbd7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/17dea7e9f26c4b74a10d5e00a395fbd7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/17dea7e9f26c4b74a10d5e00a395fbd7"}]}] Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestShelveInstance-50341482 Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 17dea7e9f26c4b74a10d5e00a395fbd7 Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestShelveInstance-50341482 Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestShelveInstance-50341482-project Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 4f9b08c0c7fd4d2e957afcefca500751 Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestShelveInstance-50341482-project Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. Jun 27 21:24:22.829092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f815a1a9-fea2-4c2a-ac39-8bf72e05d970'} Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:24:22.829943 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. Jun 27 21:24:22.831337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:24:22.832566 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Returning 404 to user: Instance f815a1a9-fea2-4c2a-ac39-8bf72e05d970 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:24:22.832566 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-63fc9153-efe3-4f66-87c9-65ab864ded71 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970" status: 404 len: 111 microversion: 2.1 time: 0.032262 Jun 27 21:24:22.832566 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 497/999] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:22 2022] GET /compute/v2.1/servers/f815a1a9-fea2-4c2a-ac39-8bf72e05d970 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:24:23.012066 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1118f6ca-1650-4659-8eed-c67821b225f3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] Calling method '.version_select at 0x7eff55b793a0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:23.047424 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1118f6ca-1650-4659-8eed-c67821b225f3 tempest-TestShelveInstance-50341482 tempest-TestShelveInstance-50341482-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1383446746" status: 202 len: 0 microversion: 2.1 time: 0.039394 Jun 27 21:24:23.048302 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 503/1000] 10.222.0.27 () {58 vars in 1253 bytes} [Mon Jun 27 21:24:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1383446746 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 27 21:24:23.379756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-ca087e9e-f6dc-47e4-9978-2bea83672ab8 req-4d374e83-ff0a-4816-95a6-9f5344607c4d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:23.388169 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-ca087e9e-f6dc-47e4-9978-2bea83672ab8 req-4d374e83-ff0a-4816-95a6-9f5344607c4d service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:23.388938 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-ca087e9e-f6dc-47e4-9978-2bea83672ab8 req-4d374e83-ff0a-4816-95a6-9f5344607c4d service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:23.401578 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-ca087e9e-f6dc-47e4-9978-2bea83672ab8 req-4d374e83-ff0a-4816-95a6-9f5344607c4d service nova] Creating event network-changed:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:24:23.408887 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-ca087e9e-f6dc-47e4-9978-2bea83672ab8 req-4d374e83-ff0a-4816-95a6-9f5344607c4d service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032541 Jun 27 21:24:23.410375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 498/1001] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:24.575931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2141650621"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:24.577127 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:24.586434 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:24.587304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:24.588856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:24.589624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:24.825798 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.network.security_group_api [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Adding security group e9c0b210-ce48-444f-b9d6-c4d6a2e0ae19 to port f996024d-89b3-4127-8b4a-7d1be9410ed4 Jun 27 21:24:25.541905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e3980ee0-1e47-4c9a-ae17-178a01bcb639 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action" status: 202 len: 0 microversion: 2.1 time: 0.970733 Jun 27 21:24:25.542621 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 504/1002] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:24:24 2022] POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action => generated 0 bytes in 972 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:24:25.553723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:25.554677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:25.560428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-cbdeb468-3c92-4fa8-b88f-b3cc47477c38 req-ee56df80-4b20-4b91-a4ff-f2108e32aa47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:25.572662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:25.575552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:25.577087 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:25.579152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:25.584169 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-cbdeb468-3c92-4fa8-b88f-b3cc47477c38 req-ee56df80-4b20-4b91-a4ff-f2108e32aa47 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:25.588093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-cbdeb468-3c92-4fa8-b88f-b3cc47477c38 req-ee56df80-4b20-4b91-a4ff-f2108e32aa47 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:25.614510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-cbdeb468-3c92-4fa8-b88f-b3cc47477c38 req-ee56df80-4b20-4b91-a4ff-f2108e32aa47 service nova] Creating event network-changed:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:24:25.625557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-cbdeb468-3c92-4fa8-b88f-b3cc47477c38 req-ee56df80-4b20-4b91-a4ff-f2108e32aa47 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.068382 Jun 27 21:24:25.626509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:25.628992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 505/1003] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:24:25.970022 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:25.987347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6e0cbcd6-9376-4fd7-ad05-1780d498aea6 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1760 microversion: 2.1 time: 0.438576 Jun 27 21:24:25.988483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 499/1004] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:25 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1760 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:49.341895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:49.343541 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:49.348016 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=34,nova_api:DELETE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:49.349050 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=76 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:49.358514 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.358957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.359745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.360168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.438652 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-840b1e43-8842-430c-89c4-69ff46fe01d8 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action" status: 202 len: 0 microversion: 2.1 time: 0.103637 Jun 27 21:24:49.439273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 506/1005] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:24:49 2022] POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:24:49.447509 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:49.448266 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:49.450413 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=34,nova_api:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:49.451157 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:24:49.457878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.458459 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.459332 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:49.459855 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:49.606205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:49.614749 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-773816f2-a00f-4608-bfd5-013e72e0494f tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1752 microversion: 2.1 time: 0.171307 Jun 27 21:24:49.615314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 500/1006] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:49 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1752 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:50.642123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:50.643311 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:50.653803 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.654536 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.655829 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:50.656542 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:50.802903 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:50.811502 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-02cda4a1-aa74-4b5f-ad2f-95da6dff5eb2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1752 microversion: 2.1 time: 0.177392 Jun 27 21:24:50.812106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 507/1007] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:50 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1752 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:51.265905 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:51.266471 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:51.273400 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.273859 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.274662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.275086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.301437 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d752d476-91a8-444a-b853-c72ce8db6f7d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/ips" status: 200 len: 145 microversion: 2.1 time: 0.039408 Jun 27 21:24:51.302161 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 501/1008] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:24:51 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/ips => generated 145 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:51.830282 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:51.830896 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:51.840393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.840985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.841880 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:51.842304 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:51.991294 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:52.000072 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9a99450d-268c-42ca-a1e8-b24434544117 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.174009 Jun 27 21:24:52.000644 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 508/1009] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:51 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:53.018556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:53.019192 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:53.026243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.026682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.027434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:53.027895 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:53.178228 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:53.188959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4e7840d1-19c5-4c7b-b48a-fc8609fe2975 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.174334 Jun 27 21:24:53.189517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 502/1010] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:53 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:54.210405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:54.211326 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:54.219765 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:54.220201 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:54.220956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:54.221379 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:54.364281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:54.373654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e6217b87-f2b8-460a-9793-11019166b2b2 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.169998 Jun 27 21:24:54.374280 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 509/1011] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:54 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:55.397008 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:55.397745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:55.404908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.405347 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:55.406100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.406528 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:55.554743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:55.563198 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-27ba19fc-eb8b-4724-8695-05818ab03734 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.170622 Jun 27 21:24:55.563821 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 503/1012] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:55 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:55.658540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "16df354a-d6b6-425b-9bed-4ab580462a2f"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:55.659755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:55.666340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.666773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:55.667553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:55.668008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:55.738375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1103342733", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-367607908", "security_groups": [{"name": "tempest-secgroup-smoke-52619586"}], "block_device_mapping_v2": [{"uuid": "0eeeda95-2b43-44e1-9f55-bc2dc3c9dd15", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef"}]}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:55.857118 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.network.neutron [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] validate_networks() for [('b2ca2a9e-f8c1-4146-86cc-0ba66531b6ef', None, None, None, None, None)] {{(pid=117893) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:24:55.936020 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2e86a636-ce45-441d-a03c-f0128f35e9f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.282632 Jun 27 21:24:55.936793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 510/1013] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:24:55 2022] POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments => generated 194 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:56.256567 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:24:56.257237 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image limits 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:24:56.257882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Flavor pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:24:56.258445 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Image pref 0:0:0 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:24:56.259045 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.virt.hardware [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117893) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:24:56.274709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:56.275254 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:56.276313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:56.277156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:56.294632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:24:56.299073 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Getting quotas for user 32b9a1c24fe84019a311b1331ea2c004 and project 4e726ed669c64a9b9d618886f1cc96de. Resources: {'ram', 'instances', 'cores'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:24:56.355631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Going to run 1 instances... {{(pid=117893) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:24:56.357752 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0eeeda95-2b43-44e1-9f55-bc2dc3c9dd15',volume_size=None,volume_type=None)] {{(pid=117893) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:24:56.498488 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-882f0226-89a4-4b1a-929f-59717c0b0d25 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.763861 Jun 27 21:24:56.504422 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 504/1014] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:24:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 765 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:24:56.510467 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a51010fb-e5a2-4d3d-a5e4-77cf64c19c38 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:56.511418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a51010fb-e5a2-4d3d-a5e4-77cf64c19c38 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:56.565846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a51010fb-e5a2-4d3d-a5e4-77cf64c19c38 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:56.572979 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a51010fb-e5a2-4d3d-a5e4-77cf64c19c38 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1094 microversion: 2.1 time: 0.067117 Jun 27 21:24:56.573531 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 511/1015] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:56 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:56.581061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:56.581641 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:56.588295 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:56.588920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:56.589848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:56.590322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:56.742734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:56.752697 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-859c8df5-0b87-4483-8195-bfdbbe6a330d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.175383 Jun 27 21:24:56.753334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 505/1016] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:56 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:57.590716 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:57.591404 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:57.599121 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.599564 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:57.600367 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.600800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:57.667172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:57.675329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c482ecd6-b825-4b03-8363-9ad8492db855 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1200 microversion: 2.1 time: 0.088933 Jun 27 21:24:57.675926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 512/1017] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:57 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1200 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:57.770260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:57.770880 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:57.777444 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.777997 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:57.778850 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:57.779277 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:58.014978 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:58.023593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-91646b02-f774-43f9-94ae-cb379f46a7be tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.257178 Jun 27 21:24:58.024280 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 506/1018] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:57 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:58.693119 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:58.693855 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:58.702512 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:58.702773 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:58.703589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:58.704037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:58.849527 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:58.858399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-225580f1-4fdf-43d0-a82a-750a232f7979 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1276 microversion: 2.1 time: 0.169516 Jun 27 21:24:58.859156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 513/1019] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:58 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1276 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:59.041682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:59.042249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:59.049642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.050090 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.050868 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.051275 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.307594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:24:59.316689 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7b24402e-1564-4273-911c-3279914fe895 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.278906 Jun 27 21:24:59.318914 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 507/1020] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:59 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:24:59.502679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-60753d70-6265-47eb-8d59-ae62f26c27d5 req-d5604f21-6638-48c5-8fae-c31bc264e059 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffe2973-7f69-49a1-acda-fa18c1146551", "tag": "63c15ba7-8817-4cb5-ae90-cd180c172803"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:24:59.514210 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-60753d70-6265-47eb-8d59-ae62f26c27d5 req-d5604f21-6638-48c5-8fae-c31bc264e059 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.515037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-60753d70-6265-47eb-8d59-ae62f26c27d5 req-d5604f21-6638-48c5-8fae-c31bc264e059 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.536998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-60753d70-6265-47eb-8d59-ae62f26c27d5 req-d5604f21-6638-48c5-8fae-c31bc264e059 service nova] Creating event network-changed:63c15ba7-8817-4cb5-ae90-cd180c172803 for instance dffe2973-7f69-49a1-acda-fa18c1146551 on hv-cinder-84773 Jun 27 21:24:59.542756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-60753d70-6265-47eb-8d59-ae62f26c27d5 req-d5604f21-6638-48c5-8fae-c31bc264e059 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045423 Jun 27 21:24:59.543391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 514/1021] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:24:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:24:59.876024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:24:59.876644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:24:59.883163 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.883597 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:24:59.884367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:24:59.884792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:00.034178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:00.042124 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f690decf-0bef-4bfc-a14b-04efca331595 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1276 microversion: 2.1 time: 0.170335 Jun 27 21:25:00.042700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 508/1022] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:24:59 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:00.335976 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:00.336683 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:00.343718 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:00.344153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:00.344915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:00.345343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:00.489425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:00.497756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-edeee584-d1e5-4cbf-a02b-f59e29d70ed5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.167380 Jun 27 21:25:00.498323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 515/1023] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:00 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:01.063673 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:01.064674 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:01.075774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.076217 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.076983 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.077409 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.217535 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:01.228929 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d1c7d081-9c10-446f-89bb-9ce86979ab88 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1276 microversion: 2.1 time: 0.171671 Jun 27 21:25:01.229717 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 509/1024] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:01 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1276 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:01.519870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:01.520865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:01.530912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.531353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.532140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:01.532563 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:01.680676 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:01.689186 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-ad927e02-d0b6-42d5-9a9a-3d5a2ac77adf tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1757 microversion: 2.1 time: 0.176212 Jun 27 21:25:01.689731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 516/1025] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:01 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1757 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:02.251115 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:02.252035 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:02.262949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:02.263775 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:02.265030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:02.265740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:02.402623 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:02.410841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3d853bfb-e455-4b1e-8565-9e02fb318018 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1276 microversion: 2.1 time: 0.166929 Jun 27 21:25:02.411398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 510/1026] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:02 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1276 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:02.709691 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:02.710639 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:02.721520 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:02.722243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:02.723476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:02.724244 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:02.882079 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:02.890486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-843590c2-1e63-4032-b8ff-66feaa63155c tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1760 microversion: 2.1 time: 0.187243 Jun 27 21:25:02.891060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 517/1027] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:02 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1760 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:03.428262 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:03.428947 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:03.435863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.436308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.437082 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:03.437507 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:03.574148 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:03.581861 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8df9c254-29ee-4ab2-9114-3b0839813403 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1276 microversion: 2.1 time: 0.157563 Jun 27 21:25:03.582419 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 511/1028] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:03 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1276 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:04.528625 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1228ec34-d667-4765-8a9f-635a21ee066f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:04.535340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1228ec34-d667-4765-8a9f-635a21ee066f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.535814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1228ec34-d667-4765-8a9f-635a21ee066f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.593962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1228ec34-d667-4765-8a9f-635a21ee066f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Going to try to stop instance {{(pid=117892) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 21:25:04.598870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:04.599479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:04.606427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.606875 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.607640 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.608116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.639534 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1228ec34-d667-4765-8a9f-635a21ee066f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action" status: 202 len: 0 microversion: 2.1 time: 0.114733 Jun 27 21:25:04.640168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 518/1029] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:04 2022] POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:04.648522 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:04.649229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:04.655581 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.656054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.656830 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:04.657340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:04.756446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:04.764494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0f263ed6-864a-49d1-8416-0eb74d710c2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.169386 Jun 27 21:25:04.765285 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 512/1030] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:04 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:04.791631 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:04.800097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-aee5e445-7fbe-4c0b-aa6b-68bc2efce3bc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.155529 Jun 27 21:25:04.800668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 519/1031] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:04 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:25:05.785593 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:05.786601 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:05.796328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.796793 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.797573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.798006 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.817618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:05.818128 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:05.825140 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.825589 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.826352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:05.826779 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:05.929692 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:05.937686 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d397c97f-aa6d-4e52-bfd2-747ced87175c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.158595 Jun 27 21:25:05.938284 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 513/1032] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:05 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:05.954911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:05.958501 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:05.963370 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3393d5f1-4767-4027-b776-5df9ea83f8ea tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.149696 Jun 27 21:25:05.963966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 520/1033] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:05 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:06.954622 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:06.955212 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:06.957132 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:06.957796 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:06.964202 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:06.964659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:06.965422 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:06.965963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:06.982787 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:06.987953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:06.989034 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:06.997405 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:06.998093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:06.998958 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:06.999839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:07.142153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:07.150320 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7e4b6b18-316e-4496-9ab6-e3c32252593e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.173501 Jun 27 21:25:07.151097 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 521/1034] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:06 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:07.172729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:07.180940 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8d6e8a16-148a-41a7-be44-4bbce4ca3c56 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.230169 Jun 27 21:25:07.181545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 514/1035] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:06 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:08.172223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:08.173187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:08.184480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.184915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.185678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.186109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.198374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:08.198958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:08.206392 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.206840 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.207594 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:08.208053 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:08.320872 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:08.329141 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-77a3687e-183a-4d7d-972f-c461c2074263 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.163513 Jun 27 21:25:08.329751 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 522/1036] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:08 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:08.342505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:08.350036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-972d3253-8e05-41d9-9f6e-9aaed05a4970 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.155537 Jun 27 21:25:08.350556 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 515/1037] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:08 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:09.350518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:09.351479 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:09.360301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:09.360736 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:09.361492 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:09.361917 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:09.366359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:09.366968 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:09.373778 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:09.374539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:09.375296 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:09.375753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:09.494649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:09.503269 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4bfa283a-b90c-44a2-87da-834af50ebcc6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.159310 Jun 27 21:25:09.503834 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 523/1038] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:09 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:09.514989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:09.522639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-aa038cdf-ddf4-42ad-a69b-6d5932fffe80 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.160132 Jun 27 21:25:09.523188 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 516/1039] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:09 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:10.524170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:10.525349 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:10.533345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:10.533802 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:10.534560 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:10.534985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:10.539569 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:10.540243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:10.547375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:10.547886 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:10.548677 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:10.549162 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:10.567919 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=100 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:10.668648 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:10.676583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d07873dd-8acb-4270-a36f-78644eab6282 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.158957 Jun 27 21:25:10.677161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 524/1040] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:10 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:10.682772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:10.690390 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8d5d55e9-8503-46da-a168-1f14eec2839c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.154785 Jun 27 21:25:10.690970 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 517/1041] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:10 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:11.696999 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:11.697584 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:11.706391 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:11.706762 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:11.707229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:11.707316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:11.707586 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:11.708046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:11.714135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:11.714570 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:11.715367 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:11.715871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:11.841599 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:11.850317 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-03c55e6d-80a0-4d9f-a9b3-86551d3c8c11 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.159475 Jun 27 21:25:11.850906 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 525/1042] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:11 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:11.860534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:11.868182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9e42c148-6c9d-4ff9-b95a-a6f8247c107c tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.165649 Jun 27 21:25:11.868729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 518/1043] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:11 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:12.868321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:12.868884 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:12.876260 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:12.876706 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:12.877477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:12.877908 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:12.885511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:12.886093 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:12.893195 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:12.893637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:12.894398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:12.894825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:13.033343 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:13.036576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:13.041550 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-21e8ae65-47a7-465b-85ba-cbd9029d165a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.177238 Jun 27 21:25:13.042204 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 526/1044] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:12 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:13.044482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b3fbbbc3-9e40-40d0-af0d-f15c7bb731e2 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.163166 Jun 27 21:25:13.045040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 519/1045] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:12 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:14.061681 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:14.062397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:14.063863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:14.064581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:14.070441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:14.071001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:14.071905 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:14.072410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:14.072579 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:14.073079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:14.073952 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:14.074446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:14.207891 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:14.208058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:14.216047 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9611f831-906a-4f61-a62d-86c6af546880 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.156816 Jun 27 21:25:14.216540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-2fa3db7d-2443-4a24-bf22-473b872e19b6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1721 microversion: 2.1 time: 0.160750 Jun 27 21:25:14.216647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 520/1046] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:14 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:14.217279 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 527/1047] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:14 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:14.643563 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-2eb43c4c-753c-4fcd-8fcb-53bb08b5f174 req-7b3735a4-0686-42c3-a12a-1a58d394b67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffe2973-7f69-49a1-acda-fa18c1146551", "name": "network-vif-plugged", "status": "completed", "tag": "63c15ba7-8817-4cb5-ae90-cd180c172803"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:14.652585 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2eb43c4c-753c-4fcd-8fcb-53bb08b5f174 req-7b3735a4-0686-42c3-a12a-1a58d394b67f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:14.653062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2eb43c4c-753c-4fcd-8fcb-53bb08b5f174 req-7b3735a4-0686-42c3-a12a-1a58d394b67f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:14.667763 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-2eb43c4c-753c-4fcd-8fcb-53bb08b5f174 req-7b3735a4-0686-42c3-a12a-1a58d394b67f service nova] Creating event network-vif-plugged:63c15ba7-8817-4cb5-ae90-cd180c172803 for instance dffe2973-7f69-49a1-acda-fa18c1146551 on hv-cinder-84773 Jun 27 21:25:14.673137 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-2eb43c4c-753c-4fcd-8fcb-53bb08b5f174 req-7b3735a4-0686-42c3-a12a-1a58d394b67f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033342 Jun 27 21:25:14.673729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 521/1048] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:15.235617 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:15.236247 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:15.236545 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:15.237238 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:15.243329 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.243712 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.243854 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.244210 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.244562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.244903 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.245012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.245331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.376183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:15.378267 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:15.384552 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ac8ed4c-9899-42a5-9832-6328466d9065 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1698 microversion: 2.1 time: 0.153413 Jun 27 21:25:15.385129 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 522/1049] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:15 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1698 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:15.385776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4a4da7f8-12c3-4ea6-a5c8-4e5e971fcf35 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1264 microversion: 2.1 time: 0.155038 Jun 27 21:25:15.386452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 528/1050] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:15 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:25:15.401705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bb4c3cec-059d-4be6-9f73-e7367a6ce47b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:15.408211 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb4c3cec-059d-4be6-9f73-e7367a6ce47b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.408656 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb4c3cec-059d-4be6-9f73-e7367a6ce47b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.468709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb4c3cec-059d-4be6-9f73-e7367a6ce47b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Going to try to start instance {{(pid=117893) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 21:25:15.513882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb4c3cec-059d-4be6-9f73-e7367a6ce47b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action" status: 202 len: 0 microversion: 2.1 time: 0.115553 Jun 27 21:25:15.514403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 523/1051] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:15 2022] POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:15.522576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:15.523188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:15.529427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.529873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.530634 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:15.531093 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:15.676270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:15.684365 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5a93d924-5275-4b3e-aaab-5ccfd33cb034 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1707 microversion: 2.1 time: 0.165649 Jun 27 21:25:15.684993 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 529/1052] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:15 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:16.408463 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:16.409620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:16.420344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.421097 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.422342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.423050 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.568111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:16.578499 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bc4c62b4-0e4c-49b6-b8e5-a7fe504f408d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1451 microversion: 2.1 time: 0.178001 Jun 27 21:25:16.579085 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 524/1053] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:16 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1451 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:16.594704 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:16.595308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:16.602159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.602602 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.603363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.603870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.701991 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:16.703107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:16.708935 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.709379 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.710135 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:16.710560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:16.740844 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:16.749451 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5f891bc9-63cb-4c29-82f5-d3a1527f0ac8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1451 microversion: 2.1 time: 0.158333 Jun 27 21:25:16.750189 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 530/1054] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:16 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1451 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:16.895483 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:16.906272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7359ee2e-364a-4d1a-83f0-ad5fbb2b08ff tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1707 microversion: 2.1 time: 0.208161 Jun 27 21:25:16.906845 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 525/1055] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:16 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1707 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:17.923988 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:17.924572 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:17.931295 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:17.931762 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:17.932513 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:17.932938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:18.154774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:18.164797 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-dc26fa4e-2d9d-4c20-816a-580fc1ec94ee tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1707 microversion: 2.1 time: 0.244899 Jun 27 21:25:18.165356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 531/1056] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:17 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1707 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:18.622381 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-a9124f22-e024-4160-82fa-1a4988d3711e req-516f3281-2f27-4802-9bea-42252620d871 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffe2973-7f69-49a1-acda-fa18c1146551", "tag": "63c15ba7-8817-4cb5-ae90-cd180c172803"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:18.631912 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a9124f22-e024-4160-82fa-1a4988d3711e req-516f3281-2f27-4802-9bea-42252620d871 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:18.632433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a9124f22-e024-4160-82fa-1a4988d3711e req-516f3281-2f27-4802-9bea-42252620d871 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:18.643520 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-a9124f22-e024-4160-82fa-1a4988d3711e req-516f3281-2f27-4802-9bea-42252620d871 service nova] Creating event network-changed:63c15ba7-8817-4cb5-ae90-cd180c172803 for instance dffe2973-7f69-49a1-acda-fa18c1146551 on hv-cinder-84773 Jun 27 21:25:18.648696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-a9124f22-e024-4160-82fa-1a4988d3711e req-516f3281-2f27-4802-9bea-42252620d871 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030228 Jun 27 21:25:18.649292 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 526/1057] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:19.182505 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:19.183245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:19.191046 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:19.191517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:19.192396 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:19.192795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:19.326515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:19.334635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-217302c4-e166-47a1-8ab3-4336cb5c1174 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1711 microversion: 2.1 time: 0.156113 Jun 27 21:25:19.335227 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 532/1058] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:19 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1711 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:41.710885 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:41.712098 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:41.717534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2141650621"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:41.718150 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:41.726012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:41.726447 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:41.727205 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:41.727652 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:41.871370 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.network.security_group_api [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Removing security group e9c0b210-ce48-444f-b9d6-c4d6a2e0ae19 from port f996024d-89b3-4127-8b4a-7d1be9410ed4 Jun 27 21:25:42.218841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c8c71816-565c-42bc-99d8-4ac40e79c3ef tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action" status: 202 len: 0 microversion: 2.1 time: 0.509628 Jun 27 21:25:42.218841 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 527/1059] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:41 2022] POST /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:42.226532 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-034104df-05a2-41bb-9729-5754f59eeda3 req-b05bd58a-dece-4204-be9e-5c2ccf21953b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:42.235544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=56 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:42.236661 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=72 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:42.240177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-034104df-05a2-41bb-9729-5754f59eeda3 req-b05bd58a-dece-4204-be9e-5c2ccf21953b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:42.241131 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-034104df-05a2-41bb-9729-5754f59eeda3 req-b05bd58a-dece-4204-be9e-5c2ccf21953b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:42.258107 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-034104df-05a2-41bb-9729-5754f59eeda3 req-b05bd58a-dece-4204-be9e-5c2ccf21953b service nova] Creating event network-changed:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:25:42.265137 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-034104df-05a2-41bb-9729-5754f59eeda3 req-b05bd58a-dece-4204-be9e-5c2ccf21953b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042941 Jun 27 21:25:42.265945 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 533/1060] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:43.571207 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:43.571806 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:43.573824 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-5277eed7-96d2-475f-8383-54a5bad2f790 req-37f86cfe-150d-4396-9433-2c6e6f0aa1f4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:43.578490 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.579159 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.580019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.580455 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.582939 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5277eed7-96d2-475f-8383-54a5bad2f790 req-37f86cfe-150d-4396-9433-2c6e6f0aa1f4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.583838 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5277eed7-96d2-475f-8383-54a5bad2f790 req-37f86cfe-150d-4396-9433-2c6e6f0aa1f4 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.595385 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-5277eed7-96d2-475f-8383-54a5bad2f790 req-37f86cfe-150d-4396-9433-2c6e6f0aa1f4 service nova] Creating event network-changed:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:25:43.600566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-5277eed7-96d2-475f-8383-54a5bad2f790 req-37f86cfe-150d-4396-9433-2c6e6f0aa1f4 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031729 Jun 27 21:25:43.601242 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 534/1061] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:43.668839 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lazy-loading 'services' on Instance uuid 400b0469-df72-4f41-80a5-ee04d29b7730 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:25:43.749581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e6b88da1-98e8-4436-a7f6-038587aae589 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments/892877b1-2900-4ebc-a560-47dd723155d0" status: 202 len: 0 microversion: 2.1 time: 0.183131 Jun 27 21:25:43.750286 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 528/1062] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:25:43 2022] DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments/892877b1-2900-4ebc-a560-47dd723155d0 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:43.759413 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:43.760795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:43.767726 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.768517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.769482 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:43.770143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:43.804557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e7913620-129b-4da6-a7e4-4c1834e6f444 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049573 Jun 27 21:25:43.810192 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 535/1063] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:25:43 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:44.818436 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:44.819489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:44.826174 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.826634 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.827397 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.827871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.857023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-89dbbcc2-38ad-4174-9394-12ffd24f0769 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043218 Jun 27 21:25:44.857711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 529/1064] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:25:44 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:25:44.867926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:44.868458 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:44.875593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.876064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.876852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:44.877281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:44.953420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] HTTP exception thrown: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 is not attached to volume 892877b1-2900-4ebc-a560-47dd723155d0 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Request method failure captured: Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments/892877b1-2900-4ebc-a560-47dd723155d0 HTTP/1.1 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh_PrOCRH3rLse09_LtcejeUyN3a7FOXI4WnolTowycvbq5uHlwHCtYaF7sewNa-KG3PBWx3UmfoWWWXKCvCEBpCcy3MygiqpZ64T1R3ua8BWdw1Jk4n5YZDwGM42PU5A0ya1Dr3JTSE0rmeplRO8th7C1IIvVb4LuU3f8d2nrnTVOY Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 61525140325a4b14aa10df2b64efa5cd Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:25:44.955788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61525140325a4b14aa10df2b64efa5cd"}]}] Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 61525140325a4b14aa10df2b64efa5cd Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-TestMinimumBasicScenario-1057793459-project Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 19e54ac48c1943b0999baeaad67a0e11 Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-TestMinimumBasicScenario-1057793459-project Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:25:44.957486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 is not attached to volume 892877b1-2900-4ebc-a560-47dd723155d0 Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'server_id': '400b0469-df72-4f41-80a5-ee04d29b7730', 'id': '892877b1-2900-4ebc-a560-47dd723155d0'} Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 892877b1-2900-4ebc-a560-47dd723155d0. Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:25:44.958416 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 is not attached to volume 892877b1-2900-4ebc-a560-47dd723155d0 Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 is not attached to volume 892877b1-2900-4ebc-a560-47dd723155d0 Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:44.959951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Returning 404 to user: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 is not attached to volume 892877b1-2900-4ebc-a560-47dd723155d0 {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:25:44.961110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-59d0c12c-a81c-4d57-972a-ceb2bcce4c9d tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments/892877b1-2900-4ebc-a560-47dd723155d0" status: 404 len: 154 microversion: 2.1 time: 0.094150 Jun 27 21:25:44.961110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 536/1065] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:25:44 2022] DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730/os-volume_attachments/892877b1-2900-4ebc-a560-47dd723155d0 => generated 154 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:25:46.102435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:46.102941 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:46.110299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.110754 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.111489 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.111996 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.139783 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:25:46.222248 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c64469f1-994c-47e8-950e-4b2f5b94aba1 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 204 len: 0 microversion: 2.1 time: 0.123608 Jun 27 21:25:46.222951 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 530/1066] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:25:46 2022] DELETE /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:25:46.231275 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:46.231957 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:46.238668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.239105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.239900 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:46.240328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:46.371487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:46.379890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-842b5360-9c1b-4a93-ae55-6eaf4de1d735 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1555 microversion: 2.1 time: 0.152436 Jun 27 21:25:46.380452 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 537/1067] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:46 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:47.407666 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:47.408857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:47.419040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.419816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.421062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:47.421756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:47.561221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:47.570504 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b9711681-2ebb-4f85-a492-6f6acc99c00b tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1555 microversion: 2.1 time: 0.170146 Jun 27 21:25:47.571500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 531/1068] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:47 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1555 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:48.590557 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:48.591221 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:48.598021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.598449 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.599187 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.599839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.735820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '19e54ac48c1943b0999baeaad67a0e11', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '61525140325a4b14aa10df2b64efa5cd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:48.743566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-155107af-031a-402a-a781-7c266cb599ed tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 200 len: 1555 microversion: 2.1 time: 0.157055 Jun 27 21:25:48.744156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 538/1069] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:48 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 1555 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:25:48.815860 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-b7df60d2-81a0-4c5e-b79c-877d30b9f381 req-bb3e2801-99b5-480a-8686-40398d2df57b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "400b0469-df72-4f41-80a5-ee04d29b7730", "name": "network-vif-deleted", "tag": "f996024d-89b3-4127-8b4a-7d1be9410ed4"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:48.824669 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b7df60d2-81a0-4c5e-b79c-877d30b9f381 req-bb3e2801-99b5-480a-8686-40398d2df57b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:48.825094 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b7df60d2-81a0-4c5e-b79c-877d30b9f381 req-bb3e2801-99b5-480a-8686-40398d2df57b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:48.836112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-b7df60d2-81a0-4c5e-b79c-877d30b9f381 req-bb3e2801-99b5-480a-8686-40398d2df57b service nova] Creating event network-vif-deleted:f996024d-89b3-4127-8b4a-7d1be9410ed4 for instance 400b0469-df72-4f41-80a5-ee04d29b7730 on hv-cinder-84773 Jun 27 21:25:48.840878 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-b7df60d2-81a0-4c5e-b79c-877d30b9f381 req-bb3e2801-99b5-480a-8686-40398d2df57b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028857 Jun 27 21:25:48.841655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 532/1070] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:25:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:25:49.765306 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:49.766245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] [instance: 400b0469-df72-4f41-80a5-ee04d29b7730] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:49.775226 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:49.775696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:49.776464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:49.776910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:49.790371 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] HTTP exception thrown: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Request method failure captured: Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 HTTP/1.1 Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh_PrOCRH3rLse09_LtcejeUyN3a7FOXI4WnolTowycvbq5uHlwHCtYaF7sewNa-KG3PBWx3UmfoWWWXKCvCEBpCcy3MygiqpZ64T1R3ua8BWdw1Jk4n5YZDwGM42PU5A0ya1Dr3JTSE0rmeplRO8th7C1IIvVb4LuU3f8d2nrnTVOY Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 61525140325a4b14aa10df2b64efa5cd Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:25:49.791919 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/61525140325a4b14aa10df2b64efa5cd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/61525140325a4b14aa10df2b64efa5cd"}]}] Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 61525140325a4b14aa10df2b64efa5cd Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1057793459 Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-TestMinimumBasicScenario-1057793459-project Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 19e54ac48c1943b0999baeaad67a0e11 Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-TestMinimumBasicScenario-1057793459-project Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. Jun 27 21:25:49.793277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '400b0469-df72-4f41-80a5-ee04d29b7730'} Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:25:49.794060 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. Jun 27 21:25:49.795435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:25:49.796876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Returning 404 to user: Instance 400b0469-df72-4f41-80a5-ee04d29b7730 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:25:49.796876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0308d5d1-9ad0-4015-9373-13adac04d4ca tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730" status: 404 len: 111 microversion: 2.1 time: 0.034519 Jun 27 21:25:49.796876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 539/1071] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:49 2022] GET /compute/v2.1/servers/400b0469-df72-4f41-80a5-ee04d29b7730 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:25:49.802817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5ade4606-cb9d-4fef-bbd3-0981de54d9c5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] Calling method '.version_select at 0x7eff5ab77f70>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:49.824095 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5ade4606-cb9d-4fef-bbd3-0981de54d9c5 tempest-TestMinimumBasicScenario-1057793459 tempest-TestMinimumBasicScenario-1057793459-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1616978358" status: 202 len: 0 microversion: 2.1 time: 0.025403 Jun 27 21:25:49.824796 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 533/1072] 10.222.0.27 () {58 vars in 1271 bytes} [Mon Jun 27 21:25:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1616978358 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:57.453933 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:57.454460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:57.461421 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:57.461943 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:57.462827 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:57.463364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:57.780203 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lazy-loading 'services' on Instance uuid c8785309-a893-4621-abff-634c21f4cb12 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:25:57.860702 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b98bca25-58e8-4013-8dae-8bcbf5cf4f3f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments/16df354a-d6b6-425b-9bed-4ab580462a2f" status: 202 len: 0 microversion: 2.1 time: 0.411479 Jun 27 21:25:57.861385 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 540/1073] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:25:57 2022] DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments/16df354a-d6b6-425b-9bed-4ab580462a2f => generated 0 bytes in 413 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:58.980619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-17c1b12f-8639-4f15-a4b0-e2e78559c274 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:25:58.983318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=41,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:25:58.990243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17c1b12f-8639-4f15-a4b0-e2e78559c274 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:58.990682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-17c1b12f-8639-4f15-a4b0-e2e78559c274 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:59.015195 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-17c1b12f-8639-4f15-a4b0-e2e78559c274 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Going to try to stop instance {{(pid=117893) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 27 21:25:59.064042 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-17c1b12f-8639-4f15-a4b0-e2e78559c274 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action" status: 202 len: 0 microversion: 2.1 time: 0.087475 Jun 27 21:25:59.064639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 534/1074] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:25:58 2022] POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:25:59.073439 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:25:59.074134 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:25:59.081423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:59.081861 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:59.082627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:25:59.083065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:25:59.220030 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:25:59.228076 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-fc6d0006-fd93-418f-ad2c-e3d92b95d2d4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.158880 Jun 27 21:25:59.228673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 541/1075] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:25:59 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:00.249581 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:00.250454 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:00.259743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:00.260327 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:00.261319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:00.261874 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:00.512180 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:00.520577 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4eff6eff-f8d9-4bf7-af0e-c0f74a7afcf4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.277295 Jun 27 21:26:00.521221 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 535/1076] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:00 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:01.544573 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:01.549243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:01.560267 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:01.560980 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:01.562233 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:01.562944 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:01.698168 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:01.709441 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5cec4ddc-527a-4287-83b4-89f9152eb836 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.173925 Jun 27 21:26:01.710012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 542/1077] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:01 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:02.730936 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:02.732059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:02.741751 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:02.742198 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:02.742955 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:02.743381 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:02.882647 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:02.890308 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a5f07941-c075-4395-88ad-98cc982c7981 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.165942 Jun 27 21:26:02.890877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 536/1078] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:02 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:03.907729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:03.908361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:03.915464 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:03.915996 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:03.916770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:03.917165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:04.052039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:04.060440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-45c16e1e-2f96-45d6-84e0-c48435a50755 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.156723 Jun 27 21:26:04.067667 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 543/1079] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:03 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:05.080274 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:05.080882 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:05.092434 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:05.093104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:05.094253 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:05.094879 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:05.233399 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:05.245533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-9ce04219-f7c0-463c-8812-3b13741689f9 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.170720 Jun 27 21:26:05.246260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 537/1080] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:05 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:06.271293 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:06.272794 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:06.279932 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:06.280375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:06.281102 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:06.281525 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:06.426352 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:06.434290 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a25c6e17-6d20-4f5f-a344-6bea64744f4f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.169333 Jun 27 21:26:06.434852 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 544/1081] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:06 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:07.455870 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:07.456746 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:07.467908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:07.468619 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:07.469926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:07.470639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:07.626851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:07.636884 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-77c85fcb-4ae9-4dcf-9ba5-cf9788320075 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.187608 Jun 27 21:26:07.637521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 538/1082] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:07 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:08.658505 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:08.659440 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:08.670427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:08.671172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:08.672484 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:08.673200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:08.803783 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:08.811442 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-da54ee65-7652-4d4e-912a-bea5f68efa4e tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1675 microversion: 2.1 time: 0.159552 Jun 27 21:26:08.812031 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 545/1083] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:08 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1675 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:09.833325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:09.835126 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:09.850736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:09.851500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:09.852851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:09.853350 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:09.990702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:09.999268 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f288df8e-9bd3-4bd7-84dc-8e4517606ac8 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1652 microversion: 2.1 time: 0.172778 Jun 27 21:26:09.999869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 539/1084] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:09 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1652 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:10.015821 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-658494d1-650b-42ef-a41a-8804a2b2a8cb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:10.022760 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-658494d1-650b-42ef-a41a-8804a2b2a8cb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:10.023197 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-658494d1-650b-42ef-a41a-8804a2b2a8cb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:10.045266 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-658494d1-650b-42ef-a41a-8804a2b2a8cb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Going to try to start instance {{(pid=117892) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 27 21:26:10.088165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-658494d1-650b-42ef-a41a-8804a2b2a8cb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action" status: 202 len: 0 microversion: 2.1 time: 0.076058 Jun 27 21:26:10.088886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 546/1085] 10.222.0.27 () {60 vars in 1277 bytes} [Mon Jun 27 21:26:10 2022] POST /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:10.097365 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:10.097974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:10.104514 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:10.104963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:10.105768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:10.106243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:10.293432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:10.301607 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eb107699-39b1-4687-8ecf-8492934007e7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1661 microversion: 2.1 time: 0.208098 Jun 27 21:26:10.302322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 540/1086] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:10 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1661 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:11.323031 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:11.323920 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:11.332436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:11.332961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:11.333921 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:11.334453 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:11.481545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:11.489654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5b5d0e3a-ed85-4922-b50f-b77247ce0a19 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1661 microversion: 2.1 time: 0.173406 Jun 27 21:26:11.490191 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 547/1087] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:11 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1661 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:12.509322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:12.509961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:12.512345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:12.517867 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:12.518310 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:12.519062 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:12.519516 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:12.672721 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:12.683031 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2eb414f1-1906-47fe-b93f-cc6c13a07895 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1665 microversion: 2.1 time: 0.178731 Jun 27 21:26:12.683891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 541/1088] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:12 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1665 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:13.279692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:26:13.280298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Mon Jun 27 21:26:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:26:45.760228 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:45.761264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:45.763708 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=30 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:45.764380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:45.770635 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.771074 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.771856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.772281 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.801675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3187cf9f-3461-40ef-986e-079ded15ab0f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045564 Jun 27 21:26:45.802213 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 548/1089] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:26:45 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:26:45.860772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:45.861380 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:45.863639 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:45.864342 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:26:45.870695 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.871140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.871944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:45.872357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:45.898920 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:26:45.987340 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-16813d98-c62c-4315-ac95-89e92c984ee6 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 204 len: 0 microversion: 2.1 time: 0.130283 Jun 27 21:26:45.988247 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 542/1090] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:26:45 2022] DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:26:45.996451 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:45.997159 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:46.003877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:46.004323 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:46.005115 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:46.005547 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:46.140631 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:46.151353 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-b42f0ed4-31d7-4d85-8b90-54a5f16a82f7 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1671 microversion: 2.1 time: 0.158784 Jun 27 21:26:46.151955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 549/1091] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:45 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1671 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:47.172648 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:47.173405 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:47.179755 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:47.180215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:47.180963 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:47.181393 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:47.317244 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:47.329270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8abb6346-33bf-4814-b1a4-510223bab341 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1671 microversion: 2.1 time: 0.162824 Jun 27 21:26:47.330113 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 543/1092] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:47 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1671 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:48.350808 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:48.351445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:48.358347 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:48.358797 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:48.359582 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:48.360028 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:48.491325 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:48.498764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-92f5f79e-b562-4cb7-bbf1-9f71151591de tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1671 microversion: 2.1 time: 0.151908 Jun 27 21:26:48.499722 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 550/1093] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:48 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1671 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:49.190721 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-2dbeb5e0-0754-4944-ac2e-7ecedfab66ac req-8fdf7ed1-dc55-4c36-a59e-e48ddd325059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c8785309-a893-4621-abff-634c21f4cb12", "name": "network-vif-deleted", "tag": "a9f64a51-ebfd-4ad5-82b2-59817c27b136"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:49.199754 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2dbeb5e0-0754-4944-ac2e-7ecedfab66ac req-8fdf7ed1-dc55-4c36-a59e-e48ddd325059 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.200733 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-2dbeb5e0-0754-4944-ac2e-7ecedfab66ac req-8fdf7ed1-dc55-4c36-a59e-e48ddd325059 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.212700 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-2dbeb5e0-0754-4944-ac2e-7ecedfab66ac req-8fdf7ed1-dc55-4c36-a59e-e48ddd325059 service nova] Creating event network-vif-deleted:a9f64a51-ebfd-4ad5-82b2-59817c27b136 for instance c8785309-a893-4621-abff-634c21f4cb12 on hv-cinder-84773 Jun 27 21:26:49.217961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-2dbeb5e0-0754-4944-ac2e-7ecedfab66ac req-8fdf7ed1-dc55-4c36-a59e-e48ddd325059 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095635 Jun 27 21:26:49.221698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 544/1094] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:49.516024 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:49.516689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:49.523742 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.524268 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.525034 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.525462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.563907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:49.565510 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:49.565863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lazy-loading 'fault' on Instance uuid c8785309-a893-4621-abff-634c21f4cb12 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:26:49.611903 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:49.619890 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-37066666-a4e0-46e2-bf14-6e389a794592 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 200 len: 1326 microversion: 2.1 time: 0.107919 Jun 27 21:26:49.620567 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 551/1095] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:49 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 1326 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:50.641155 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:50.641898 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:50.652453 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:50.653026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:50.654179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:50.654796 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:50.668551 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 HTTP/1.1 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:26:50.670156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:26:50.672027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'c8785309-a893-4621-abff-634c21f4cb12'} Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:26:50.672910 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:26:50.674272 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:26:50.675553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:26:50.675553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8d3bb8a8-8a50-4377-bfb0-f5c4e792437b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 404 len: 111 microversion: 2.1 time: 0.036452 Jun 27 21:26:50.675553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 545/1096] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:50 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:26:50.680540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f60a1564-c338-4a99-8458-e91ea3ef892b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '.version_select at 0x7eff55b909d0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:50.701211 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f60a1564-c338-4a99-8458-e91ea3ef892b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-147597308" status: 202 len: 0 microversion: 2.1 time: 0.024480 Jun 27 21:26:50.701760 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 552/1097] 10.222.0.27 () {58 vars in 1217 bytes} [Mon Jun 27 21:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-147597308 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:26:51.324741 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-73092208-5cae-4eb6-9a3a-0fc5f09beb52 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: .version_select at 0x7eff562b09d0>, body: {"keypair": {"name": "tempest-keypair-1587923498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBLpQ5MQg3sX6XGwsr8J/2HLLHKN5SRMa+HJUbSaopwW9trV3Pe6HH/W+pSybW+8GErch9hvnmAoMCmgpYUEmpUQHF+VSZ/hmF5hs+n4JzGsuoUTkafyyDjq3PZg5mnTFw=="}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:51.339232 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-73092208-5cae-4eb6-9a3a-0fc5f09beb52 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for project 412630dcb5ff4402983a02b249583995. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:26:51.343069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.quota [None req-73092208-5cae-4eb6-9a3a-0fc5f09beb52 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for user 6eb164ecd85f498f9c3b3aabe90dc054 and project 412630dcb5ff4402983a02b249583995. Resources: {'key_pairs'} {{(pid=117893) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:26:51.365846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-73092208-5cae-4eb6-9a3a-0fc5f09beb52 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045070 Jun 27 21:26:51.366429 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 546/1098] 10.222.0.27 () {60 vars in 1158 bytes} [Mon Jun 27 21:26:51 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:52.658136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2074055562", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "764b886e-d7e2-4f36-a72e-1bbb767ce292"}], "security_groups": [{"name": "tempest-securitygroup--913296893"}], "key_name": "tempest-keypair-1587923498", "user_data": "}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:52.760870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] validate_networks() for [('764b886e-d7e2-4f36-a72e-1bbb767ce292', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:26:53.155083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:26:53.155493 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:26:53.156001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:26:53.156399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:26:53.156814 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:26:53.166460 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:53.166901 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:53.167771 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:53.168223 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:53.186795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for project 412630dcb5ff4402983a02b249583995. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:26:53.190883 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Getting quotas for user 6eb164ecd85f498f9c3b3aabe90dc054 and project 412630dcb5ff4402983a02b249583995. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:26:53.201804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:26:53.204232 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:26:53.254143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d79de0bd-95f2-40a4-916b-12c2effc5759 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.601277 Jun 27 21:26:53.254786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 553/1099] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:26:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 603 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:26:53.265479 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b553ad53-2a8a-45fe-bffb-75a778a2d46c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:53.266170 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b553ad53-2a8a-45fe-bffb-75a778a2d46c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:53.322541 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b553ad53-2a8a-45fe-bffb-75a778a2d46c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:53.333709 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b553ad53-2a8a-45fe-bffb-75a778a2d46c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1238 microversion: 2.1 time: 0.071422 Jun 27 21:26:53.334408 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 547/1100] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:53 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1238 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:26:54.353537 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:54.354355 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:54.362770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:54.363361 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:54.364496 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:54.365103 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:54.435045 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:54.442830 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-528e9efb-2dd0-40b0-9409-9c9b58bfe880 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1290 microversion: 2.1 time: 0.095338 Jun 27 21:26:54.443435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 554/1101] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:54 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1290 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:55.461486 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:55.462038 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:55.469015 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:55.469438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:55.470213 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:55.470573 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:55.710452 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:55.721142 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-36d0c69e-c475-4be6-a027-68d8894f14cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.264756 Jun 27 21:26:55.721760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 548/1102] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:55 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:56.151056 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-cebd0e9a-7039-4a09-9d7b-476b76248962 req-3f477d56-0df4-486d-b85f-cef84d79222f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49", "tag": "d11ed5e1-610e-4c8d-988e-802d9beb6a61"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:56.180285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-cebd0e9a-7039-4a09-9d7b-476b76248962 req-3f477d56-0df4-486d-b85f-cef84d79222f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:56.180669 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-cebd0e9a-7039-4a09-9d7b-476b76248962 req-3f477d56-0df4-486d-b85f-cef84d79222f service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:56.192690 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-cebd0e9a-7039-4a09-9d7b-476b76248962 req-3f477d56-0df4-486d-b85f-cef84d79222f service nova] Creating event network-changed:d11ed5e1-610e-4c8d-988e-802d9beb6a61 for instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 on hv-cinder-84773 Jun 27 21:26:56.197559 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-cebd0e9a-7039-4a09-9d7b-476b76248962 req-3f477d56-0df4-486d-b85f-cef84d79222f service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052092 Jun 27 21:26:56.198543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 555/1103] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:56.739092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:56.739711 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:56.746651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:56.747086 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:56.747888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:56.748311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:56.951249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:56.959458 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0224c43f-d19c-44b9-ab42-6419816ca2b1 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.224478 Jun 27 21:26:56.960080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 549/1104] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:56 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:57.977613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:57.978975 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:57.985624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:57.986065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:57.986826 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:57.987254 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.126590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:58.134340 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3341afb1-473c-4044-b39c-73a964d43036 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.161451 Jun 27 21:26:58.134916 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 556/1105] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:57 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:58.819491 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:58.820061 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:58.821777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-e0ed7d96-d824-4181-a7b2-3199e5f51f29 req-89d741a9-da3b-4d57-806c-0f6f96869a25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dffe2973-7f69-49a1-acda-fa18c1146551", "tag": "63c15ba7-8817-4cb5-ae90-cd180c172803"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:26:58.826827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.827260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.828059 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.828564 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.830239 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e0ed7d96-d824-4181-a7b2-3199e5f51f29 req-89d741a9-da3b-4d57-806c-0f6f96869a25 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.830895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-e0ed7d96-d824-4181-a7b2-3199e5f51f29 req-89d741a9-da3b-4d57-806c-0f6f96869a25 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.842771 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-e0ed7d96-d824-4181-a7b2-3199e5f51f29 req-89d741a9-da3b-4d57-806c-0f6f96869a25 service nova] Creating event network-changed:63c15ba7-8817-4cb5-ae90-cd180c172803 for instance dffe2973-7f69-49a1-acda-fa18c1146551 on hv-cinder-84773 Jun 27 21:26:58.848679 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-e0ed7d96-d824-4181-a7b2-3199e5f51f29 req-89d741a9-da3b-4d57-806c-0f6f96869a25 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Jun 27 21:26:58.852498 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 557/1106] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:26:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:26:58.859482 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Going to try to terminate instance {{(pid=117893) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:26:58.951324 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb86fcd9-6395-4a07-ae64-74a5f07229ea tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "DELETE /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 204 len: 0 microversion: 2.1 time: 0.135502 Jun 27 21:26:58.955130 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 550/1107] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:26:58 2022] DELETE /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:26:58.961789 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:58.962491 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:58.971495 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.971977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:58.972750 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:58.973755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.113804 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:59.121767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d8e4981b-3d68-4927-8583-b67cf1634a08 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1576 microversion: 2.1 time: 0.165024 Jun 27 21:26:59.122375 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 558/1108] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:58 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:26:59.151036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:26:59.151769 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:26:59.158100 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:59.158553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.159325 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:26:59.159790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:26:59.293658 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:26:59.301374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-458beac8-4d40-4239-b1f7-8cfd84cb72bf tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.154647 Jun 27 21:26:59.301953 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 551/1109] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:26:59 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:00.141332 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:00.142026 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:00.150752 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.151277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.152321 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.152893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.318416 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:00.319740 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:00.328512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.328974 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.329784 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:00.330215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:00.470357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:00.477888 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8d8cc053-0c24-4356-acd8-5b8f36c92a26 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.163466 Jun 27 21:27:00.478481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 552/1110] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:00 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:00.541384 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:00.549138 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7dc5b88b-1df2-4272-9ca3-533c30d5612f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1576 microversion: 2.1 time: 0.413259 Jun 27 21:27:00.549698 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 559/1111] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:00 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1576 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:01.486877 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-c2a1b279-2a63-4b5d-93b3-6b4c06bb3e96 req-59ef2102-5d40-49af-9552-50095ca600e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dffe2973-7f69-49a1-acda-fa18c1146551", "name": "network-vif-deleted", "tag": "63c15ba7-8817-4cb5-ae90-cd180c172803"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:01.494064 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:01.494646 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:01.498670 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-c2a1b279-2a63-4b5d-93b3-6b4c06bb3e96 req-59ef2102-5d40-49af-9552-50095ca600e8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.499122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-c2a1b279-2a63-4b5d-93b3-6b4c06bb3e96 req-59ef2102-5d40-49af-9552-50095ca600e8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.501310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.501931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.502856 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.503435 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.510633 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-c2a1b279-2a63-4b5d-93b3-6b4c06bb3e96 req-59ef2102-5d40-49af-9552-50095ca600e8 service nova] Creating event network-vif-deleted:63c15ba7-8817-4cb5-ae90-cd180c172803 for instance dffe2973-7f69-49a1-acda-fa18c1146551 on hv-cinder-84773 Jun 27 21:27:01.515229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-c2a1b279-2a63-4b5d-93b3-6b4c06bb3e96 req-59ef2102-5d40-49af-9552-50095ca600e8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093029 Jun 27 21:27:01.515851 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 553/1112] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:01.567270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:01.568019 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:01.574344 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.574783 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.575533 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:01.575961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:01.634363 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:01.638391 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:01.642373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-4429bb92-5cc4-4751-9b44-51b04cd94f0a tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.151994 Jun 27 21:27:01.643271 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 560/1113] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:01 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:27:01.647816 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-4ac0b76d-926c-4c4e-8c38-d3972fa08ca8 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 200 len: 1225 microversion: 2.1 time: 0.084934 Jun 27 21:27:01.648383 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 554/1114] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:01 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:02.663423 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:02.664877 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:02.671140 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:02.672177 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: dffe2973-7f69-49a1-acda-fa18c1146551] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:02.674904 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:02.675350 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:02.676157 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:02.676592 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:02.678849 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:02.679283 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:02.680287 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:02.680705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:02.694306 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] HTTP exception thrown: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Request method failure captured: Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 HTTP/1.1 Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh6e-sQE7fymYcGSY9dyBrvGNY633PXjW-Mxo6ylyvGFlQIXnudT7o-irMgow8Qv1GarsZVk1-5zkHehLNpF7O04qyEiiy64s96AU2CUhr-LLlBSuAFv8-ifyHcXXLwHVD9bUilm-LeUaYWzoRpJOv4tWC15NIGesbp5pF0XeMKDf1A Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:27:02.696052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}] Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 32b9a1c24fe84019a311b1331ea2c004 Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. Jun 27 21:27:02.697642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'dffe2973-7f69-49a1-acda-fa18c1146551'} Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:27:02.698495 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. Jun 27 21:27:02.699843 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:02.701120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Returning 404 to user: Instance dffe2973-7f69-49a1-acda-fa18c1146551 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:27:02.701120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3fabd85d-f8fe-4904-9e0f-916ef33a7b7b tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551" status: 404 len: 111 microversion: 2.1 time: 0.033804 Jun 27 21:27:02.701120 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 555/1115] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:02 2022] GET /compute/v2.1/servers/dffe2973-7f69-49a1-acda-fa18c1146551 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:27:02.809721 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:02.817236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-04cc7ab1-c7ff-4bd9-84c8-6129c6c49358 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.160411 Jun 27 21:27:02.817865 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 561/1116] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:02 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:03.402659 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-b4b92d56-059d-44fd-80ef-94b53e28c90c req-40f135af-c74b-4ace-b0eb-3182147b2597 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49", "name": "network-vif-plugged", "status": "completed", "tag": "d11ed5e1-610e-4c8d-988e-802d9beb6a61"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:03.406309 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:03.412894 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b4b92d56-059d-44fd-80ef-94b53e28c90c req-40f135af-c74b-4ace-b0eb-3182147b2597 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:03.413331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-b4b92d56-059d-44fd-80ef-94b53e28c90c req-40f135af-c74b-4ace-b0eb-3182147b2597 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:03.426028 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-b4b92d56-059d-44fd-80ef-94b53e28c90c req-40f135af-c74b-4ace-b0eb-3182147b2597 service nova] Creating event network-vif-plugged:d11ed5e1-610e-4c8d-988e-802d9beb6a61 for instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 on hv-cinder-84773 Jun 27 21:27:03.430883 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-b4b92d56-059d-44fd-80ef-94b53e28c90c req-40f135af-c74b-4ace-b0eb-3182147b2597 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032010 Jun 27 21:27:03.431492 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 556/1117] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:03.838882 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:03.839953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:03.843926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:03.845200 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:03.851692 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:03.852139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:03.852950 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:03.853388 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:03.986314 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:03.994106 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7fc61ed4-6e76-464d-a9f3-5504f167a0ef tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.162506 Jun 27 21:27:03.994866 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 562/1118] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:03 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:05.014939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:05.015746 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:05.022705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.023146 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.023958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.024383 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.158522 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:05.166173 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f644face-103b-45c2-8083-e5a68e54f07d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1363 microversion: 2.1 time: 0.156319 Jun 27 21:27:05.166742 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 557/1119] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:05 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:05.819654 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:05.820545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:05.821412 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-91968ec2-a223-4bf6-b4f2-b7639220019a req-9c8fa542-cf82-4b64-becb-77131b485b06 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83c9fa96-14c9-46b3-a1fc-a9a1d2a99762", "tag": "d9fd079e-447c-4359-acd1-aea7c7b6d077"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:05.827319 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.827886 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.828735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.829346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.829893 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-91968ec2-a223-4bf6-b4f2-b7639220019a req-9c8fa542-cf82-4b64-becb-77131b485b06 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.830517 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-91968ec2-a223-4bf6-b4f2-b7639220019a req-9c8fa542-cf82-4b64-becb-77131b485b06 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.842143 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-91968ec2-a223-4bf6-b4f2-b7639220019a req-9c8fa542-cf82-4b64-becb-77131b485b06 service nova] Creating event network-changed:d9fd079e-447c-4359-acd1-aea7c7b6d077 for instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 on hv-cinder-84773 Jun 27 21:27:05.847532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-91968ec2-a223-4bf6-b4f2-b7639220019a req-9c8fa542-cf82-4b64-becb-77131b485b06 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029847 Jun 27 21:27:05.848433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 558/1120] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:05.858425 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:27:05.952029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7ff74c0b-2e2f-4fa9-9b26-d396d1279f2d tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 204 len: 0 microversion: 2.1 time: 0.135699 Jun 27 21:27:05.953012 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 563/1121] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:27:05 2022] DELETE /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:27:05.962547 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:05.963543 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:05.970592 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.971079 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:05.972107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:05.972549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:06.113246 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:06.121046 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-3a81fe54-b8e2-4dab-b527-0419771e8f84 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1576 microversion: 2.1 time: 0.162978 Jun 27 21:27:06.121637 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 559/1122] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:05 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:06.184083 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:06.184893 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:06.191341 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:06.191805 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:06.192560 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:06.193356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:06.328037 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:06.336610 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3752d756-57ad-4954-8a4b-0158eb12a917 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1548 microversion: 2.1 time: 0.156779 Jun 27 21:27:06.337165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 564/1123] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:06 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:06.353857 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:06.354433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:06.361945 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:06.362403 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:06.363251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:06.363787 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:06.444792 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0f73567e-5e1a-4735-be04-e5d002ca1511 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094902 Jun 27 21:27:06.445359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 560/1124] 10.222.0.27 () {58 vars in 1274 bytes} [Mon Jun 27 21:27:06 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:07.139895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:07.140472 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:07.147660 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:07.148412 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:07.151049 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:07.151700 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:07.175907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:07.333800 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:07.341553 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-884a3d7a-92d3-4263-995f-3d4faca6b1af tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1576 microversion: 2.1 time: 0.205746 Jun 27 21:27:07.342115 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 565/1125] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:07 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1576 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:27:07.660827 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-021dce03-4275-4359-a19d-91da2f5a2495 req-802ab743-d08f-4a7c-8cb0-b04a26aeb6e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49", "tag": "d11ed5e1-610e-4c8d-988e-802d9beb6a61"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:07.669333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-021dce03-4275-4359-a19d-91da2f5a2495 req-802ab743-d08f-4a7c-8cb0-b04a26aeb6e5 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:07.669826 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-021dce03-4275-4359-a19d-91da2f5a2495 req-802ab743-d08f-4a7c-8cb0-b04a26aeb6e5 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:07.681183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-021dce03-4275-4359-a19d-91da2f5a2495 req-802ab743-d08f-4a7c-8cb0-b04a26aeb6e5 service nova] Creating event network-changed:d11ed5e1-610e-4c8d-988e-802d9beb6a61 for instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 on hv-cinder-84773 Jun 27 21:27:07.686638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-021dce03-4275-4359-a19d-91da2f5a2495 req-802ab743-d08f-4a7c-8cb0-b04a26aeb6e5 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030456 Jun 27 21:27:07.687443 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 561/1126] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:08.290910 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-c7c87af0-8b8c-47c3-bc43-ee61130217cf req-e314ec94-843e-4653-9d67-d38e2c2ce0b9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83c9fa96-14c9-46b3-a1fc-a9a1d2a99762", "name": "network-vif-deleted", "tag": "d9fd079e-447c-4359-acd1-aea7c7b6d077"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:08.300774 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c7c87af0-8b8c-47c3-bc43-ee61130217cf req-e314ec94-843e-4653-9d67-d38e2c2ce0b9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:08.301231 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-c7c87af0-8b8c-47c3-bc43-ee61130217cf req-e314ec94-843e-4653-9d67-d38e2c2ce0b9 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:08.313776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-c7c87af0-8b8c-47c3-bc43-ee61130217cf req-e314ec94-843e-4653-9d67-d38e2c2ce0b9 service nova] Creating event network-vif-deleted:d9fd079e-447c-4359-acd1-aea7c7b6d077 for instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 on hv-cinder-84773 Jun 27 21:27:08.320053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-c7c87af0-8b8c-47c3-bc43-ee61130217cf req-e314ec94-843e-4653-9d67-d38e2c2ce0b9 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033340 Jun 27 21:27:08.324110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 566/1127] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:27:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:08.359375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:08.360111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:08.366462 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:08.366906 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:08.367745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:08.368179 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:08.372337 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:08.446207 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '32b9a1c24fe84019a311b1331ea2c004', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4e726ed669c64a9b9d618886f1cc96de', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:27:08.455684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-a58c4b70-0803-4442-943c-978e92a162cc tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 200 len: 1225 microversion: 2.1 time: 0.100566 Jun 27 21:27:08.456268 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 562/1128] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:08 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 1225 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:27:09.478344 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:09.479518 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:09.488395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.488831 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:09.489588 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.490014 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:09.503731 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] HTTP exception thrown: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Request method failure captured: Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 HTTP/1.1 Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh6e-sQE7fymYcGSY9dyBrvGNY633PXjW-Mxo6ylyvGFlQIXnudT7o-irMgow8Qv1GarsZVk1-5zkHehLNpF7O04qyEiiy64s96AU2CUhr-LLlBSuAFv8-ifyHcXXLwHVD9bUilm-LeUaYWzoRpJOv4tWC15NIGesbp5pF0XeMKDf1A Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:27:09.505346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}] Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 32b9a1c24fe84019a311b1331ea2c004 Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. Jun 27 21:27:09.507090 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '83c9fa96-14c9-46b3-a1fc-a9a1d2a99762'} Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:27:09.508181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. Jun 27 21:27:09.509851 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.511778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Returning 404 to user: Instance 83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:27:09.511778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-63d8d13e-4a30-496f-901f-55e9b3017b51 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762" status: 404 len: 111 microversion: 2.1 time: 0.036316 Jun 27 21:27:09.511778 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 567/1129] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:09 2022] GET /compute/v2.1/servers/83c9fa96-14c9-46b3-a1fc-a9a1d2a99762 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:27:09.951311 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:09.951833 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:09.958846 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.959280 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:09.960072 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.960493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:09.973750 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] HTTP exception thrown: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Request method failure captured: Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: DELETE /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 HTTP/1.1 Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh6e-sQE7fymYcGSY9dyBrvGNY633PXjW-Mxo6ylyvGFlQIXnudT7o-irMgow8Qv1GarsZVk1-5zkHehLNpF7O04qyEiiy64s96AU2CUhr-LLlBSuAFv8-ifyHcXXLwHVD9bUilm-LeUaYWzoRpJOv4tWC15NIGesbp5pF0XeMKDf1A Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:27:09.975382 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}] Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 32b9a1c24fe84019a311b1331ea2c004 Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:09.976965 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'f989e41d-0c15-4c0b-b96b-4286820a9b48'} Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:27:09.977773 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:09.979104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:27:09.980722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Returning 404 to user: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:27:09.980722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-cc864044-ff2b-414e-8013-5946093e86a0 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "DELETE /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 404 len: 111 microversion: 2.1 time: 0.029476 Jun 27 21:27:09.980722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 563/1130] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:27:09 2022] DELETE /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:27:09.986040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:09.986659 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] [instance: f989e41d-0c15-4c0b-b96b-4286820a9b48] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:09.993155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.993601 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:09.994841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:09.994841 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:10.009136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] HTTP exception thrown: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Request method failure captured: Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 HTTP/1.1 Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh6e-sQE7fymYcGSY9dyBrvGNY633PXjW-Mxo6ylyvGFlQIXnudT7o-irMgow8Qv1GarsZVk1-5zkHehLNpF7O04qyEiiy64s96AU2CUhr-LLlBSuAFv8-ifyHcXXLwHVD9bUilm-LeUaYWzoRpJOv4tWC15NIGesbp5pF0XeMKDf1A Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:27:10.010670 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/4e726ed669c64a9b9d618886f1cc96de"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/4e726ed669c64a9b9d618886f1cc96de"}]}] Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 4e726ed669c64a9b9d618886f1cc96de Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-TestVolumeBootPattern-1111570372 Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 32b9a1c24fe84019a311b1331ea2c004 Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-TestVolumeBootPattern-1111570372-project Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:10.012345 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'f989e41d-0c15-4c0b-b96b-4286820a9b48'} Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:27:10.013153 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. Jun 27 21:27:10.014511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:27:10.015770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Returning 404 to user: Instance f989e41d-0c15-4c0b-b96b-4286820a9b48 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:27:10.015770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-212d72f0-6da4-435e-84a2-47c5fefd5a18 tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48" status: 404 len: 111 microversion: 2.1 time: 0.030061 Jun 27 21:27:10.015770 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 568/1131] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:27:09 2022] GET /compute/v2.1/servers/f989e41d-0c15-4c0b-b96b-4286820a9b48 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:27:11.329410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ea5832a6-fe07-458b-ac59-579d1314ac3f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] Calling method '.version_select at 0x7eff561cc5e0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:11.349193 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ea5832a6-fe07-458b-ac59-579d1314ac3f tempest-TestVolumeBootPattern-1111570372 tempest-TestVolumeBootPattern-1111570372-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367607908" status: 202 len: 0 microversion: 2.1 time: 0.023556 Jun 27 21:27:11.349768 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 564/1132] 10.222.0.27 () {58 vars in 1259 bytes} [Mon Jun 27 21:27:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-367607908 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:27:43.749483 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:43.750445 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:43.754129 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=63,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:43.755165 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=8 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:43.764328 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:43.765092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:43.766397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:43.767277 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:43.792451 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d059449e-179a-4a78-b7a6-bcf2050d7cc5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/ips" status: 200 len: 145 microversion: 2.1 time: 0.049695 Jun 27 21:27:43.793015 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 569/1133] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:27:43 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/ips => generated 145 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:45.133789 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=6 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:45.134595 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:27:45.138764 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ebe5e274-fe4d-4b71-a456-93c85b9dce9c"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:45.139892 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:45.147863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:45.148351 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:45.149104 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:45.149508 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:45.431871 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2a544e36-5fe2-48db-9ad3-a09b997eb021 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.299271 Jun 27 21:27:45.432869 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 565/1134] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:27:45 2022] POST /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 194 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:45.674187 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:27:45.674410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:27:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:27:53.001354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:53.002301 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:53.009040 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:53.009487 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:53.010245 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:53.010678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:53.043955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c6d8bc39-d202-4a6b-a08e-191d18e3da86 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046746 Jun 27 21:27:53.044515 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 570/1135] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:27:52 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:53.060774 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:27:53.061359 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:53.070554 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:53.070990 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:53.071782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:53.072197 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:53.102627 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f385d571-7510-477a-913e-bfceda4c38d5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c" status: 200 len: 194 microversion: 2.1 time: 0.049134 Jun 27 21:27:53.103211 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 566/1136] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 27 21:27:53 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c => generated 194 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:27:54.453673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87e98a9f-7b81-46b9-b9fa-7e3cdc41a5b6"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:27:54.454744 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:27:54.461768 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:54.462209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:54.462967 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:27:54.463393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:27:54.752420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-bb74ab64-5f20-4b0a-af60-d2fd6595a50b tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "POST /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.302573 Jun 27 21:27:54.753605 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 571/1137] 10.222.0.27 () {60 vars in 1322 bytes} [Mon Jun 27 21:27:54 2022] POST /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 194 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:02.280065 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:02.281058 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:02.287944 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.288404 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.289156 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.289586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.319949 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b061447e-6700-4ce3-b10a-4e7d53edbfe3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.043941 Jun 27 21:28:02.320494 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 567/1138] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:28:02 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 371 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:02.488057 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:02.488697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:02.496092 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.496509 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.497262 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.497688 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.532737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7efa3515-2612-4dbc-ba74-53982d622604 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c" status: 200 len: 194 microversion: 2.1 time: 0.049017 Jun 27 21:28:02.533318 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 572/1139] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 27 21:28:02 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:02.544926 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:02.545413 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:02.552078 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.552519 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.553273 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:02.553701 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:02.641934 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lazy-loading 'services' on Instance uuid 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:28:02.719759 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6d8035ed-975d-4a42-b368-1f2b77ddaa1c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c" status: 202 len: 0 microversion: 2.1 time: 0.178669 Jun 27 21:28:02.720378 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 568/1140] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:28:02 2022] DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/ebe5e274-fe4d-4b71-a456-93c85b9dce9c => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:28:04.913499 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:04.914110 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:04.922229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:04.922671 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:04.923417 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:04.923873 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:04.952586 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-64f31bc0-bf23-4f64-950d-89c6b511128d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/87e98a9f-7b81-46b9-b9fa-7e3cdc41a5b6" status: 200 len: 194 microversion: 2.1 time: 0.046287 Jun 27 21:28:04.953156 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 573/1141] 10.222.0.27 () {58 vars in 1412 bytes} [Mon Jun 27 21:28:04 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/87e98a9f-7b81-46b9-b9fa-7e3cdc41a5b6 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:04.966662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:04.967190 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:04.974116 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:04.974559 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:04.975322 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:04.975770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:05.059863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lazy-loading 'services' on Instance uuid 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:28:05.135526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ca8b4829-2442-434f-a88f-8bd6a6b0eda4 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/87e98a9f-7b81-46b9-b9fa-7e3cdc41a5b6" status: 202 len: 0 microversion: 2.1 time: 0.173571 Jun 27 21:28:05.136165 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 569/1142] 10.222.0.27 () {58 vars in 1415 bytes} [Mon Jun 27 21:28:04 2022] DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments/87e98a9f-7b81-46b9-b9fa-7e3cdc41a5b6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:28:06.299992 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:06.300998 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:06.307756 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.308193 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.308938 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.309364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.337954 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d26e29a1-6633-489b-994d-d7ffd2387dc3 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042095 Jun 27 21:28:06.338480 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 574/1143] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:28:06 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:28:06.463588 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:06.464632 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:06.471815 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.472250 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.473080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.473505 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.502856 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ad4afd62-67d3-42d4-b784-ee743fb889eb tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043520 Jun 27 21:28:06.503707 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 570/1144] 10.222.0.27 () {58 vars in 1301 bytes} [Mon Jun 27 21:28:06 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 27 21:28:06.563977 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:06.564461 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:06.570544 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.570983 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.571790 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.572218 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.596410 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:28:06.685936 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f4b57eb1-46f9-421e-b6fb-c1eff0696afa tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 204 len: 0 microversion: 2.1 time: 0.125655 Jun 27 21:28:06.686519 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 575/1145] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:06 2022] DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:28:06.695068 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:06.695705 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:06.701753 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.702183 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.702928 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:06.703375 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:06.844316 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:06.852074 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bb527dd9-7853-44b8-857b-a9dbefdc56cd tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1673 microversion: 2.1 time: 0.160862 Jun 27 21:28:06.852623 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 571/1146] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:06 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1673 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:07.873528 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:07.874473 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:07.885177 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:07.885907 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:07.887105 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:07.887864 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:08.024753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:08.032629 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-f3613834-4375-4594-b5a8-a0efecd15a5d tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1673 microversion: 2.1 time: 0.165595 Jun 27 21:28:08.033172 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 576/1147] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:07 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1673 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:09.049730 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:09.050372 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:09.057244 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:09.057675 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:09.058446 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:09.058863 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:09.287269 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:09.295800 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-8df23cbd-78b8-445d-bb90-68af78a4ff80 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1673 microversion: 2.1 time: 0.250040 Jun 27 21:28:09.296368 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 572/1148] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:09 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1673 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:09.781234 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-2ab77f3a-398e-4290-ac10-273d88e73bd7 req-9bceb728-946c-46eb-90dd-4539e3d2b1f8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49", "name": "network-vif-deleted", "tag": "d11ed5e1-610e-4c8d-988e-802d9beb6a61"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:09.791962 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-2ab77f3a-398e-4290-ac10-273d88e73bd7 req-9bceb728-946c-46eb-90dd-4539e3d2b1f8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:09.792526 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-2ab77f3a-398e-4290-ac10-273d88e73bd7 req-9bceb728-946c-46eb-90dd-4539e3d2b1f8 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:09.804136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-2ab77f3a-398e-4290-ac10-273d88e73bd7 req-9bceb728-946c-46eb-90dd-4539e3d2b1f8 service nova] Creating event network-vif-deleted:d11ed5e1-610e-4c8d-988e-802d9beb6a61 for instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 on hv-cinder-84773 Jun 27 21:28:09.809001 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-2ab77f3a-398e-4290-ac10-273d88e73bd7 req-9bceb728-946c-46eb-90dd-4539e3d2b1f8 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031482 Jun 27 21:28:09.809604 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 577/1149] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:28:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:10.313555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:10.314191 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:10.321024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:10.321468 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:10.322433 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:10.323026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:10.356770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:10.357477 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:10.358073 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.objects.instance [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lazy-loading 'fault' on Instance uuid 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 {{(pid=117893) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:28:10.418715 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6eb164ecd85f498f9c3b3aabe90dc054', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '412630dcb5ff4402983a02b249583995', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:28:10.426005 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5252e390-4124-4f16-9ce9-781c4be22b9c tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 200 len: 1328 microversion: 2.1 time: 0.116662 Jun 27 21:28:10.426586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 573/1150] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:10 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 1328 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:28:11.448147 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:11.449291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:11.457761 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:11.458202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:11.458961 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:11.459392 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:11.473065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 HTTP/1.1 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:28:11.474753 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:11.476360 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49'} Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:11.477486 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:11.479085 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:11.480699 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:11.480699 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e69dc39e-0275-4454-a5d6-f7c6c76d2188 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 404 len: 111 microversion: 2.1 time: 0.035886 Jun 27 21:28:11.480699 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 578/1151] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:11 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:11.485702 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e67e7e59-0ea8-48e7-b141-b4d6ff9d54df tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '.version_select at 0x7eff561cc3a0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:11.507024 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e67e7e59-0ea8-48e7-b141-b4d6ff9d54df tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587923498" status: 202 len: 0 microversion: 2.1 time: 0.025257 Jun 27 21:28:11.507586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 574/1152] 10.222.0.27 () {58 vars in 1220 bytes} [Mon Jun 27 21:28:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1587923498 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:28:14.427031 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:14.427545 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:14.430000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:14.435574 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:14.436055 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:14.436818 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:14.437250 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:14.440678 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=64,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:14.453828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 HTTP/1.1 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:28:14.455579 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.457202 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49'} Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:14.458039 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.459430 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.460888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:14.460888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-9f999109-e1b8-4a71-a0a9-690ae2129678 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 404 len: 111 microversion: 2.1 time: 0.034420 Jun 27 21:28:14.460888 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 579/1153] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:14 2022] DELETE /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:14.468271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:14.468939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:14.479558 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:14.480172 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:14.481297 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:14.481837 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:14.496683 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 HTTP/1.1 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:28:14.498318 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.499890 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49'} Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:14.500651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. Jun 27 21:28:14.501950 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:14.503048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance 83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:14.503048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-de962758-81b8-482e-9826-44815931e87f tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49" status: 404 len: 111 microversion: 2.1 time: 0.037875 Jun 27 21:28:14.503048 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 575/1154] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:14 2022] GET /compute/v2.1/servers/83f9ab6e-a97d-44fe-ae1c-20ac14ea7f49 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:15.650953 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:15.651511 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:15.659120 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:15.659558 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:15.660354 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:15.660767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:15.674351 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 HTTP/1.1 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:28:15.675968 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: > Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.677543 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': 'c8785309-a893-4621-abff-634c21f4cb12'} Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:15.678356 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.679664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.680956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:15.680956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-af889f9a-2cd4-4f54-8891-0c76c522f1a5 tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 404 len: 111 microversion: 2.1 time: 0.031113 Jun 27 21:28:15.680956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 580/1155] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:28:15 2022] DELETE /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:15.685732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:15.686333 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] [instance: c8785309-a893-4621-abff-634c21f4cb12] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:28:15.688805 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=26,nova_api:DELETE=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:15.694251 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:15.694682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:15.695426 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:28:15.695907 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:28:15.699152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:15.711089 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] HTTP exception thrown: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Request method failure captured: Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 HTTP/1.1 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuh_uZ1jPJhTzYdMkN-TDAjZQHxB5PvxLuLN9IKLq6e_DKyUALhIydORBl63qdnL5Cc5fK8w_XcKBxYMJEFBQkF9KxYZtrftGFcL8hzJdZJQktzFBmqqB0eFYKdF_4DIRIHMURlTxp58BZ24YpLEYVSyZiWSgCwcQBNLxflMZYSnNtnE Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:28:15.712638 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_412630dcb5ff4402983a02b249583995"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/412630dcb5ff4402983a02b249583995"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/412630dcb5ff4402983a02b249583995"}]}] Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: 412630dcb5ff4402983a02b249583995 Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-AttachVolumeTestJSON-222185425 Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 6eb164ecd85f498f9c3b3aabe90dc054 Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-AttachVolumeTestJSON-222185425-project Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.714357 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'c8785309-a893-4621-abff-634c21f4cb12'} Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:15.715331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. Jun 27 21:28:15.716939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:15.718356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] Returning 404 to user: Instance c8785309-a893-4621-abff-634c21f4cb12 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:15.718356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b2c468a6-ef8e-4588-b32f-65c73a75d1cc tempest-AttachVolumeTestJSON-222185425 tempest-AttachVolumeTestJSON-222185425-project] 10.222.0.27 "GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12" status: 404 len: 111 microversion: 2.1 time: 0.032180 Jun 27 21:28:15.718356 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 576/1156] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:28:15 2022] GET /compute/v2.1/servers/c8785309-a893-4621-abff-634c21f4cb12 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:20.186833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c08dea86-4885-404b-a978-3ae2ec59075b tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Action: 'create', calling method: .version_select at 0x7eff55c27280>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-522204666"}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:20.483145 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c08dea86-4885-404b-a978-3ae2ec59075b tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.414912 Jun 27 21:28:20.483799 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 581/1157] 10.222.0.27 () {60 vars in 1154 bytes} [Mon Jun 27 21:28:20 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 416 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 27 21:28:20.494848 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f88fff80-213d-429b-9722-aaea7e3a233a tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff562939d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:20.543314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f88fff80-213d-429b-9722-aaea7e3a233a tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 200 len: 344 microversion: 2.1 time: 0.052264 Jun 27 21:28:20.543922 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 577/1158] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:28:20 2022] GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:21.557300 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-3801c19f-4476-484b-8d0f-27171b4b9309 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff5590a0d0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:21.609624 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-3801c19f-4476-484b-8d0f-27171b4b9309 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 200 len: 345 microversion: 2.1 time: 0.056769 Jun 27 21:28:21.610176 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 582/1159] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:28:21 2022] GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:21.622560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c0a0d74e-b6c5-4ca9-bccd-202b8f81e536 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Action: 'create', calling method: .version_select at 0x7eff561cc3a0>, body: {"snapshot": {"volume_id": "40bde70b-7a98-415a-96d0-0584864fa774", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1664315033"}} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:28:21.782560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c0a0d74e-b6c5-4ca9-bccd-202b8f81e536 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.164377 Jun 27 21:28:21.783314 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 578/1160] 10.222.0.27 () {60 vars in 1161 bytes} [Mon Jun 27 21:28:21 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:21.793291 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-902ec996-ef83-4087-8880-d74f87526bb9 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff55ae9e50>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:21.824098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-902ec996-ef83-4087-8880-d74f87526bb9 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 287 microversion: 2.1 time: 0.034714 Jun 27 21:28:21.824747 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 583/1161] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:21 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:28:21.834771 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2974fcbf-d11c-4362-a42d-c336325e25d0 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff562c1280>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:21.864080 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2974fcbf-d11c-4362-a42d-c336325e25d0 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.033144 Jun 27 21:28:21.864745 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 579/1162] 10.222.0.27 () {58 vars in 1139 bytes} [Mon Jun 27 21:28:21 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:21.875419 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1988dc18-5e2c-4d6e-8ef4-b36916ce38b9 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff56660670>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:21.905626 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1988dc18-5e2c-4d6e-8ef4-b36916ce38b9 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 287 microversion: 2.1 time: 0.034248 Jun 27 21:28:21.906273 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 584/1163] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:21 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:22.920991 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-89c6d8a3-20b5-4d06-a537-41b49682c81e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff580bfca0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:22.958897 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-89c6d8a3-20b5-4d06-a537-41b49682c81e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 287 microversion: 2.1 time: 0.044681 Jun 27 21:28:22.959493 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 580/1164] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:22 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:23.975316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1c78533d-e55a-42e4-a52e-1a22edb5e158 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff577b61f0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:24.013003 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1c78533d-e55a-42e4-a52e-1a22edb5e158 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 287 microversion: 2.1 time: 0.044852 Jun 27 21:28:24.013578 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 585/1165] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:23 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 287 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:25.026206 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-d9cb8c66-cfb8-452e-b7e6-50848308052b tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff5631b820>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:25.056776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-d9cb8c66-cfb8-452e-b7e6-50848308052b tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 288 microversion: 2.1 time: 0.035121 Jun 27 21:28:25.057336 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 581/1166] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:25 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 288 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:25.068151 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-6dbb0cae-8837-4785-a39c-afef56a7e8c8 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff55bc5040>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:25.129000 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-6dbb0cae-8837-4785-a39c-afef56a7e8c8 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "DELETE /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 202 len: 0 microversion: 2.1 time: 0.065168 Jun 27 21:28:25.129912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 586/1167] 10.222.0.27 () {58 vars in 1253 bytes} [Mon Jun 27 21:28:25 2022] DELETE /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:28:25.138293 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-c923a5b9-89fb-43d9-a8d0-ee860b73a158 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff562cad30>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:25.168626 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-c923a5b9-89fb-43d9-a8d0-ee860b73a158 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 200 len: 287 microversion: 2.1 time: 0.034120 Jun 27 21:28:25.169211 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 582/1168] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:25 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:26.177964 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:26.178846 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=3 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:26.183466 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-817b0b7f-06ca-4126-8be8-fe9e521da57e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff55981310>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:26.210029 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-817b0b7f-06ca-4126-8be8-fe9e521da57e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] HTTP exception thrown: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-817b0b7f-06ca-4126-8be8-fe9e521da57e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Request method failure captured: Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b HTTP/1.1 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuiDz7skW4eZz52YBZdCdt7bSj1OJB5IHPoOLHaCrc1D4ahVS_QnTSDwCV3gtaBrDVFYkkgY2icS9Ni7X6sjfGnycVZLei6-YD3Yo-HA8QsmzVflwV3S-IOHAtxgF3cpO-iW8RGk54Afws15s0VB3VdTxe8RP4fhLU4CNCsTr4Kr4zw0 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:28:26.212333 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}] Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 582dbe6c9c874bfeb062d2a2a77516c9 Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '061cc126-1e86-4929-b627-61e1e558097b'} Jun 27 21:28:26.214005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. (HTTP 404) (Request-ID: req-3fdd31a0-c72d-4f17-a906-d9f4b4768f9e) Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.215038 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:26.216270 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 27 21:28:26.217469 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-817b0b7f-06ca-4126-8be8-fe9e521da57e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Returning 404 to user: Snapshot 061cc126-1e86-4929-b627-61e1e558097b could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:26.218712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-817b0b7f-06ca-4126-8be8-fe9e521da57e tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b" status: 404 len: 111 microversion: 2.1 time: 0.036628 Jun 27 21:28:26.219675 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 587/1169] 10.222.0.27 () {58 vars in 1250 bytes} [Mon Jun 27 21:28:26 2022] GET /compute/v2.1/os-snapshots/061cc126-1e86-4929-b627-61e1e558097b => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:26.219758 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:28:26.224121 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-5f13b674-5f96-4b59-8dae-d80c4986eb5d tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff562933a0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:26.288215 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-5f13b674-5f96-4b59-8dae-d80c4986eb5d tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 202 len: 0 microversion: 2.1 time: 0.069445 Jun 27 21:28:26.288790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 583/1170] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:28:26 2022] DELETE /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 27 21:28:26.297729 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-768f3865-78b2-4970-849e-fdcff2de5dca tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff55caaca0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:26.345820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-768f3865-78b2-4970-849e-fdcff2de5dca tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 200 len: 344 microversion: 2.1 time: 0.052508 Jun 27 21:28:26.346399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 588/1171] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:28:26 2022] GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:28:27.363389 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-34001d14-51eb-422e-9fe8-4668b59a16b5 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff562410d0>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:27.400108 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-34001d14-51eb-422e-9fe8-4668b59a16b5 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] HTTP exception thrown: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-34001d14-51eb-422e-9fe8-4668b59a16b5 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Request method failure captured: Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 HTTP/1.1 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuiDz7skW4eZz52YBZdCdt7bSj1OJB5IHPoOLHaCrc1D4ahVS_QnTSDwCV3gtaBrDVFYkkgY2icS9Ni7X6sjfGnycVZLei6-YD3Yo-HA8QsmzVflwV3S-IOHAtxgF3cpO-iW8RGk54Afws15s0VB3VdTxe8RP4fhLU4CNCsTr4Kr4zw0 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:28:27.402069 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}] Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 582dbe6c9c874bfeb062d2a2a77516c9 Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '40bde70b-7a98-415a-96d0-0584864fa774'} Jun 27 21:28:27.403411 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. (HTTP 404) (Request-ID: req-91ca892c-4cb8-4938-943f-5307b9b345c2) Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.404305 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:27.405500 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:28:27.408481 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-34001d14-51eb-422e-9fe8-4668b59a16b5 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Returning 404 to user: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-34001d14-51eb-422e-9fe8-4668b59a16b5 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 404 len: 109 microversion: 2.1 time: 0.047348 Jun 27 21:28:27.409785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 584/1172] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:28:27 2022] GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:27.418436 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d757826f-99d1-4488-90e8-a13555a31434 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff55ae98b0>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:27.446658 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.wsgi [None req-d757826f-99d1-4488-90e8-a13555a31434 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] HTTP exception thrown: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d757826f-99d1-4488-90e8-a13555a31434 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Request method failure captured: Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: request: DELETE /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 HTTP/1.1 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept: application/json Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Accept-Encoding: identity Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Connection: close Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Length: 0 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Content-Type: application/json Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Host: 10.222.0.27 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Openstack-System-Scope: None Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Auth-Token: gAAAAABiuiDz7skW4eZz52YBZdCdt7bSj1OJB5IHPoOLHaCrc1D4ahVS_QnTSDwCV3gtaBrDVFYkkgY2icS9Ni7X6sjfGnycVZLei6-YD3Yo-HA8QsmzVflwV3S-IOHAtxgF3cpO-iW8RGk54Afws15s0VB3VdTxe8RP4fhLU4CNCsTr4Kr4zw0 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Id: None Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Domain-Name: None Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Identity-Status: Confirmed Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Is-Admin-Project: True Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Id: default Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Domain-Name: Default Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Role: reader,member Jun 27 21:28:27.448618 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Roles: reader,member Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}] Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Id: default Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Domain-Name: Default Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Id: 582dbe6c9c874bfeb062d2a2a77516c9 Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: method: Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: exception: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: action_args: {'id': '40bde70b-7a98-415a-96d0-0584864fa774'} Jun 27 21:28:27.450123 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. (HTTP 404) (Request-ID: req-4ad0c644-d929-41c5-90c0-f98b60ae0513) Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.453743 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 27 21:28:27.455089 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 27 21:28:27.456310 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d757826f-99d1-4488-90e8-a13555a31434 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Returning 404 to user: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. {{(pid=117892) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d757826f-99d1-4488-90e8-a13555a31434 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "DELETE /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 404 len: 109 microversion: 2.1 time: 0.035928 Jun 27 21:28:27.457471 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 589/1173] 10.222.0.27 () {58 vars in 1247 bytes} [Mon Jun 27 21:28:27 2022] DELETE /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:28:27.459747 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac4268f0-59b8-4ff3-9e5a-718b817195c6 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Calling method '.version_select at 0x7eff56241430>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:28:27.487331 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-ac4268f0-59b8-4ff3-9e5a-718b817195c6 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] HTTP exception thrown: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac4268f0-59b8-4ff3-9e5a-718b817195c6 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Request method failure captured: Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 HTTP/1.1 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuiDz7skW4eZz52YBZdCdt7bSj1OJB5IHPoOLHaCrc1D4ahVS_QnTSDwCV3gtaBrDVFYkkgY2icS9Ni7X6sjfGnycVZLei6-YD3Yo-HA8QsmzVflwV3S-IOHAtxgF3cpO-iW8RGk54Afws15s0VB3VdTxe8RP4fhLU4CNCsTr4Kr4zw0 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:28:27.489299 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/de0b33b49efa4c049f177e03ce768686"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/de0b33b49efa4c049f177e03ce768686"}]}] Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: de0b33b49efa4c049f177e03ce768686 Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-650749409 Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 582dbe6c9c874bfeb062d2a2a77516c9 Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesSnapshotsTestJSON-650749409-project Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '40bde70b-7a98-415a-96d0-0584864fa774'} Jun 27 21:28:27.490881 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. (HTTP 404) (Request-ID: req-32cc1072-f781-4bb8-a9d1-dea4a7c5da4c) Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.491916 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 27 21:28:27.493110 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 27 21:28:27.494328 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-ac4268f0-59b8-4ff3-9e5a-718b817195c6 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] Returning 404 to user: Volume 40bde70b-7a98-415a-96d0-0584864fa774 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-ac4268f0-59b8-4ff3-9e5a-718b817195c6 tempest-VolumesSnapshotsTestJSON-650749409 tempest-VolumesSnapshotsTestJSON-650749409-project] 10.222.0.27 "GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774" status: 404 len: 109 microversion: 2.1 time: 0.034825 Jun 27 21:28:27.495532 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 585/1174] 10.222.0.27 () {58 vars in 1244 bytes} [Mon Jun 27 21:28:27 2022] GET /compute/v2.1/os-volumes/40bde70b-7a98-415a-96d0-0584864fa774 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:29:10.412428 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-738813589", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "networks": [{"uuid": "0d7b13d5-e287-45c1-9ff4-e731e9f36c50"}]}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:10.468408 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] validate_networks() for [('0d7b13d5-e287-45c1-9ff4-e731e9f36c50', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:29:10.897720 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:29:10.898134 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:29:10.898600 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:29:10.899028 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:29:10.899431 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:29:10.908521 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:10.908966 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:10.909757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:10.910185 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:10.927214 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Getting quotas for project ef69c081a67644c7aecdcc06fc8e8675. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:29:10.931161 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Getting quotas for user 836fc578997845b898bdc310ff93ca37 and project ef69c081a67644c7aecdcc06fc8e8675. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:29:10.941911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:29:10.944192 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:29:10.993735 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-669d15ad-5a2a-4526-975e-118870958432 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.586113 Jun 27 21:29:10.994640 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 590/1175] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:29:10 2022] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:29:11.001925 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=1 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:11.006642 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-85334204-8e56-44c9-9b51-7a195bc914c9 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:11.007241 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-85334204-8e56-44c9-9b51-7a195bc914c9 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:11.066527 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-85334204-8e56-44c9-9b51-7a195bc914c9 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:11.073743 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-85334204-8e56-44c9-9b51-7a195bc914c9 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1213 microversion: 2.1 time: 0.073159 Jun 27 21:29:11.074319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 586/1176] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:10 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:12.095951 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:12.096576 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:12.104839 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:12.105276 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:12.106054 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:12.106477 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:12.176600 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:12.184720 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-0d7b9b15-24fe-43e8-8a06-f803e78d85ba tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1265 microversion: 2.1 time: 0.096731 Jun 27 21:29:12.185278 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 591/1177] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:12 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:13.201536 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:13.202107 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:13.208812 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:13.209249 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:13.210027 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:13.210450 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:13.424560 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:13.432512 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-0f699a05-cae0-42cc-8b56-3575e1aed993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.234967 Jun 27 21:29:13.442334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 587/1178] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:13 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:13.650389 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-f5de2954-24e8-4e17-8d6f-b5683f0d586d req-3048ce99-41ba-49bb-b952-97abe316376b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8160e64-e5c3-4ecf-aed8-da144a75babb", "tag": "c011dc5a-c1f2-4571-b925-e32a5488811b"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:13.659776 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-f5de2954-24e8-4e17-8d6f-b5683f0d586d req-3048ce99-41ba-49bb-b952-97abe316376b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:13.660195 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-f5de2954-24e8-4e17-8d6f-b5683f0d586d req-3048ce99-41ba-49bb-b952-97abe316376b service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:13.673625 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-f5de2954-24e8-4e17-8d6f-b5683f0d586d req-3048ce99-41ba-49bb-b952-97abe316376b service nova] Creating event network-changed:c011dc5a-c1f2-4571-b925-e32a5488811b for instance d8160e64-e5c3-4ecf-aed8-da144a75babb on hv-cinder-84773 Jun 27 21:29:13.678689 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-f5de2954-24e8-4e17-8d6f-b5683f0d586d req-3048ce99-41ba-49bb-b952-97abe316376b service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032026 Jun 27 21:29:13.679334 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 592/1179] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:29:14.454438 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:14.455334 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:14.465572 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:14.466013 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:14.466776 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:14.467209 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:14.606682 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:14.614732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-36340f99-e547-4d30-b0b5-fd11eccee422 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.166971 Jun 27 21:29:14.615282 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 588/1180] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:14 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:15.633541 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:15.634238 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:15.640955 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:15.641395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:15.642170 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:15.642605 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:15.776540 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:15.784662 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-1ab831c3-8656-433c-a5d8-7e927a6e3867 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.156134 Jun 27 21:29:15.785227 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 593/1181] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:15 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:16.806948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:16.810714 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:16.818511 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:16.819182 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:16.820418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:16.821056 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:16.956549 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:16.964065 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-df044d30-b4a2-4699-bdf2-fec382bf0138 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.163495 Jun 27 21:29:16.964629 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 589/1182] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:16 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:17.981431 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:17.982034 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:17.989005 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:17.989449 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:17.990243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:17.990668 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:18.125598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:18.134143 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-7b628148-8c9d-411f-9ae7-193b9c7b9f3c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.156554 Jun 27 21:29:18.134720 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 594/1183] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:17 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:19.157791 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:19.158736 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:19.170030 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:19.170772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:19.172193 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:19.172631 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:19.304270 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:19.311817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-2fc162a7-8728-4868-b42c-6d60701d73e5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.160762 Jun 27 21:29:19.312470 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 590/1184] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:19 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:20.229034 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-9b5ddfcc-aedb-4b2f-84e9-d02eb45d0dda req-383c0a3e-da47-4e1d-91ba-efff265b8969 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8160e64-e5c3-4ecf-aed8-da144a75babb", "name": "network-vif-plugged", "status": "completed", "tag": "c011dc5a-c1f2-4571-b925-e32a5488811b"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:20.237181 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-9b5ddfcc-aedb-4b2f-84e9-d02eb45d0dda req-383c0a3e-da47-4e1d-91ba-efff265b8969 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:20.237606 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-9b5ddfcc-aedb-4b2f-84e9-d02eb45d0dda req-383c0a3e-da47-4e1d-91ba-efff265b8969 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:20.248395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-9b5ddfcc-aedb-4b2f-84e9-d02eb45d0dda req-383c0a3e-da47-4e1d-91ba-efff265b8969 service nova] Creating event network-vif-plugged:c011dc5a-c1f2-4571-b925-e32a5488811b for instance d8160e64-e5c3-4ecf-aed8-da144a75babb on hv-cinder-84773 Jun 27 21:29:20.253863 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-9b5ddfcc-aedb-4b2f-84e9-d02eb45d0dda req-383c0a3e-da47-4e1d-91ba-efff265b8969 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180051 Jun 27 21:29:20.254434 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 595/1185] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:29:20.329352 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:20.329961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:20.339418 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:20.339879 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:20.341012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:20.341620 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:20.512832 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:20.520722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-bafad756-6e88-48be-ba2d-ac8e3e8c2934 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.195644 Jun 27 21:29:20.521302 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 591/1186] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:20 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:21.537053 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:21.538063 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=6 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:21.544926 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:21.545928 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:21.553912 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:21.554337 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:21.555101 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:21.555517 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:21.692243 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:21.700286 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-d2ddee4a-93ce-42ea-87cf-1e2bbc31132e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1313 microversion: 2.1 time: 0.164874 Jun 27 21:29:21.700734 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 596/1187] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:21 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:22.721555 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:22.722432 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:22.725427 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=2 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:22.734988 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:22.735760 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:22.736989 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:22.737698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:22.872320 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:22.880219 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-83f4f440-f77e-40df-b104-b7a98dfc92ca tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1497 microversion: 2.1 time: 0.165378 Jun 27 21:29:22.880781 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 592/1188] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:22 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1497 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:23.401382 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:23.401931 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:23.408236 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:23.408673 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:23.409415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:23.409833 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:23.435359 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:29:23.530095 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-03624190-db80-44a4-9879-59f3a58e5463 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 204 len: 0 microversion: 2.1 time: 0.132495 Jun 27 21:29:23.530745 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 597/1189] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:29:23 2022] DELETE /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:29:23.539092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:23.539722 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:23.545821 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:23.546260 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:23.547012 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:23.547435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:23.680829 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:23.688430 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7f64b0a6-de62-4af7-94ce-219f7fd16ac2 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1503 microversion: 2.1 time: 0.153216 Jun 27 21:29:23.689063 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 593/1190] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:23 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1503 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:24.708045 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:24.708737 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:24.715850 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:24.716285 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:24.717017 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:24.717493 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:24.858182 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:24.867956 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a26aeb75-b863-46db-90a9-c1380eae4ba8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1503 microversion: 2.1 time: 0.164230 Jun 27 21:29:24.868703 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 598/1191] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:24 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1503 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:25.564661 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-8ef82fef-85bd-4c09-b090-5ec06b390d89 req-d0f148e5-0236-4029-87d3-1f4a21f597fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8160e64-e5c3-4ecf-aed8-da144a75babb", "name": "network-vif-deleted", "tag": "c011dc5a-c1f2-4571-b925-e32a5488811b"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:25.574112 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8ef82fef-85bd-4c09-b090-5ec06b390d89 req-d0f148e5-0236-4029-87d3-1f4a21f597fd service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:25.574553 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-8ef82fef-85bd-4c09-b090-5ec06b390d89 req-d0f148e5-0236-4029-87d3-1f4a21f597fd service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:25.585891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-8ef82fef-85bd-4c09-b090-5ec06b390d89 req-d0f148e5-0236-4029-87d3-1f4a21f597fd service nova] Creating event network-vif-deleted:c011dc5a-c1f2-4571-b925-e32a5488811b for instance d8160e64-e5c3-4ecf-aed8-da144a75babb on hv-cinder-84773 Jun 27 21:29:25.590904 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-8ef82fef-85bd-4c09-b090-5ec06b390d89 req-d0f148e5-0236-4029-87d3-1f4a21f597fd service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030088 Jun 27 21:29:25.591576 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 594/1192] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:29:25.602924 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:29:25.603109 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Mon Jun 27 21:29:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:29:25.888538 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:25.889155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:25.895881 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:25.896316 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:25.897065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:25.897696 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:25.928697 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:25.929139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:25.929575 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lazy-loading 'fault' on Instance uuid d8160e64-e5c3-4ecf-aed8-da144a75babb {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:29:25.970614 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:25.978373 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e5df55b8-8fac-4079-9842-0dc6d54ad6aa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 200 len: 1303 microversion: 2.1 time: 0.093657 Jun 27 21:29:25.978929 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 599/1193] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:25 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 1303 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:26.999023 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:26.999959 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: d8160e64-e5c3-4ecf-aed8-da144a75babb] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:27.008985 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:27.009586 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:27.010574 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:27.011145 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:27.028596 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] HTTP exception thrown: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Request method failure captured: Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb HTTP/1.1 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuiEkX2UQyb-AbBfZLSwZ6uLO3SIoyL-kn87D4Ul9R3DhG9tg_lW05rURN8ms-OijwNNJ9TFD19lyOI1axkStthhhXr9YUOkAZyLgsE_bppo4DW3V4y3EWW_t--N0EuovhmXDWVYCWThzxa1kjJMHjDb2O7oSmzmBn7FJAlqi_Kvngu4 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: ef69c081a67644c7aecdcc06fc8e8675 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:29:27.030227 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef69c081a67644c7aecdcc06fc8e8675"}]}] Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: ef69c081a67644c7aecdcc06fc8e8675 Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesActionsTest-1377338596-project Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 836fc578997845b898bdc310ff93ca37 Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesActionsTest-1377338596-project Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. Jun 27 21:29:27.032026 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': 'd8160e64-e5c3-4ecf-aed8-da144a75babb'} Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:29:27.033111 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. Jun 27 21:29:27.034785 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:27.036301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Returning 404 to user: Instance d8160e64-e5c3-4ecf-aed8-da144a75babb could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:29:27.036301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-296d8aec-5d6c-43a8-9a94-2ceac5c117ff tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb" status: 404 len: 111 microversion: 2.1 time: 0.038898 Jun 27 21:29:27.036301 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 595/1194] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:26 2022] GET /compute/v2.1/servers/d8160e64-e5c3-4ecf-aed8-da144a75babb => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:29:27.082911 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-870232988", "imageRef": "c98b1413-2cac-4fa8-83ae-36c9ff47de44", "flavorRef": "452", "networks": [{"uuid": "0d7b13d5-e287-45c1-9ff4-e731e9f36c50"}]}} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:27.134023 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.network.neutron [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] validate_networks() for [('0d7b13d5-e287-45c1-9ff4-e731e9f36c50', None, None, None, None, None)] {{(pid=117892) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 27 21:29:27.484792 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Flavor limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 27 21:29:27.485377 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Image limits 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 27 21:29:27.486065 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Flavor pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 27 21:29:27.486726 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Image pref 0:0:0 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 27 21:29:27.487326 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.virt.hardware [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117892) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 27 21:29:27.501427 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:27.501985 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:27.502793 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:27.503255 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:27.520476 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Getting quotas for project ef69c081a67644c7aecdcc06fc8e8675. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 27 21:29:27.524777 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.quota [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Getting quotas for user 836fc578997845b898bdc310ff93ca37 and project ef69c081a67644c7aecdcc06fc8e8675. Resources: {'ram', 'instances', 'cores'} {{(pid=117892) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 27 21:29:27.536041 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Going to run 1 instances... {{(pid=117892) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 27 21:29:27.538264 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c98b1413-2cac-4fa8-83ae-36c9ff47de44',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117892) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 27 21:29:27.584767 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-c61c5a37-825e-46dd-93a1-e541daa34aa6 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.505817 Jun 27 21:29:27.585397 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 600/1195] 10.222.0.27 () {60 vars in 1146 bytes} [Mon Jun 27 21:29:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 507 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 27 21:29:27.595729 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-7628afc7-08ec-4600-aace-dd4d2478e77e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:27.596485 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-7628afc7-08ec-4600-aace-dd4d2478e77e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:27.650387 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-7628afc7-08ec-4600-aace-dd4d2478e77e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:27.657353 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-7628afc7-08ec-4600-aace-dd4d2478e77e tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1213 microversion: 2.1 time: 0.065665 Jun 27 21:29:27.657939 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 596/1196] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:27 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:28.679415 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a4525110-1983-4b91-8fcf-15e8374816fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:28.680418 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a4525110-1983-4b91-8fcf-15e8374816fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:28.738209 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a4525110-1983-4b91-8fcf-15e8374816fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:28.745008 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a4525110-1983-4b91-8fcf-15e8374816fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1213 microversion: 2.1 time: 0.073172 Jun 27 21:29:28.745566 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 601/1197] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:28 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1213 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:29.766534 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-76d626b2-8328-47f7-9666-11cabd384664 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:29.767696 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-76d626b2-8328-47f7-9666-11cabd384664 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:29.833523 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-76d626b2-8328-47f7-9666-11cabd384664 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:29.840765 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-76d626b2-8328-47f7-9666-11cabd384664 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1213 microversion: 2.1 time: 0.080781 Jun 27 21:29:29.841330 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 597/1198] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:29 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1213 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:30.856870 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:30.857433 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:30.864139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:30.864556 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:30.865309 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:30.865764 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:30.932171 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:30.940136 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cb45feff-e694-48d2-bb2c-e94e8469f5fe tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1271 microversion: 2.1 time: 0.086945 Jun 27 21:29:30.940741 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 602/1199] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:30 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1271 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:31.958036 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:31.958651 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:31.965491 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:31.965961 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:31.966708 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:31.967138 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:32.152178 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:32.160319 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-6965ffde-b679-4dd9-9e7b-763e925cf8d5 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.206420 Jun 27 21:29:32.160908 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 598/1200] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:31 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:32.201702 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-5daf9b5a-ce65-48cb-9b5a-94b3afa9ea5c req-f7c95d24-e6b0-41f2-9291-a3fbd8a79b64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "03f48887-9ad5-4e36-a83f-aa9a5b021116", "tag": "ef7880bc-8949-4698-b75d-349384fb58fc"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:32.210283 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5daf9b5a-ce65-48cb-9b5a-94b3afa9ea5c req-f7c95d24-e6b0-41f2-9291-a3fbd8a79b64 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:32.210712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-5daf9b5a-ce65-48cb-9b5a-94b3afa9ea5c req-f7c95d24-e6b0-41f2-9291-a3fbd8a79b64 service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:32.223585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-5daf9b5a-ce65-48cb-9b5a-94b3afa9ea5c req-f7c95d24-e6b0-41f2-9291-a3fbd8a79b64 service nova] Creating event network-changed:ef7880bc-8949-4698-b75d-349384fb58fc for instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 on hv-cinder-84773 Jun 27 21:29:32.228577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-5daf9b5a-ce65-48cb-9b5a-94b3afa9ea5c req-f7c95d24-e6b0-41f2-9291-a3fbd8a79b64 service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030596 Jun 27 21:29:32.229188 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 603/1201] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:29:33.182052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:33.183186 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:33.193732 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:33.194201 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:33.195016 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:33.195448 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:33.339503 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:33.347518 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-e4c5b449-10c7-4d42-9b8d-129b85c1c7cc tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.172067 Jun 27 21:29:33.348122 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 599/1202] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:33 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:34.368406 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:34.369183 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:34.376366 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:34.376828 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:34.377622 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:34.378070 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:34.511571 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:34.522562 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-5154f405-37a3-4edf-b70a-17ab6794396b tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.160590 Jun 27 21:29:34.523139 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 604/1203] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:34 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:35.543684 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:35.544656 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:35.555678 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:35.556539 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:35.557782 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:35.558538 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:35.705004 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:35.716725 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-66174921-46c7-48dd-beed-42ad29978609 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.179211 Jun 27 21:29:35.717506 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 600/1204] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:35 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:36.739848 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:36.740630 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:36.749554 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:36.750058 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:36.751073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:36.751655 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:36.892915 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:36.901229 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-a2c629f9-784c-4454-94a7-705b37b6aa7c tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.167876 Jun 27 21:29:36.901788 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 605/1205] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:36 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:37.922264 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:37.923271 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:37.934323 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:37.935054 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:37.936345 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:37.937052 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:38.273613 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [req-16959da3-6718-40b4-aa89-c12ef00ad0c1 req-a60456f1-f00a-4d62-bf57-58f0ceba62cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f48887-9ad5-4e36-a83f-aa9a5b021116", "name": "network-vif-plugged", "status": "completed", "tag": "ef7880bc-8949-4698-b75d-349384fb58fc"}]} {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:38.281590 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=2 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:38.284667 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-16959da3-6718-40b4-aa89-c12ef00ad0c1 req-a60456f1-f00a-4d62-bf57-58f0ceba62cc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:38.285380 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [req-16959da3-6718-40b4-aa89-c12ef00ad0c1 req-a60456f1-f00a-4d62-bf57-58f0ceba62cc service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:38.297364 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.compute.server_external_events [req-16959da3-6718-40b4-aa89-c12ef00ad0c1 req-a60456f1-f00a-4d62-bf57-58f0ceba62cc service nova] Creating event network-vif-plugged:ef7880bc-8949-4698-b75d-349384fb58fc for instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 on hv-cinder-84773 Jun 27 21:29:38.302313 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [req-16959da3-6718-40b4-aa89-c12ef00ad0c1 req-a60456f1-f00a-4d62-bf57-58f0ceba62cc service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032820 Jun 27 21:29:38.303268 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 606/1206] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 27 21:29:38.353521 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:38.361087 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-b3eb3375-d758-4047-91de-6167ba78a081 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.445495 Jun 27 21:29:38.361643 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 601/1207] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:37 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:39.378073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell0:SELECT=8 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:39.384125 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:39.384821 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:39.391420 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:39.391895 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:39.392649 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:39.393073 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:39.527627 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:39.535195 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-842de12e-1ea3-4d80-a9bc-b7d1ed65a5c8 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1313 microversion: 2.1 time: 0.159194 Jun 27 21:29:39.535786 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 607/1208] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:39 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1313 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:40.555040 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:40.555698 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:40.559229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell0:SELECT=4 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:40.563596 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:40.564067 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:40.564819 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:40.565243 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:40.706020 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:40.714125 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-f850a7b7-988d-4382-8382-a0951dd2f0e4 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1496 microversion: 2.1 time: 0.164658 Jun 27 21:29:40.714662 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 602/1209] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:40 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1496 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:41.241602 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:41.242160 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:41.244448 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_api:SELECT=68,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:41.250098 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:41.250577 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:41.251400 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:41.251909 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:41.256583 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG dbcounter [-] [117892] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117892) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:41.280251 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Going to try to terminate instance {{(pid=117892) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 27 21:29:41.362395 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-e32c5f03-9027-4251-8b3d-c740a16f30fa tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "DELETE /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 204 len: 0 microversion: 2.1 time: 0.124335 Jun 27 21:29:41.363021 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 608/1210] 10.222.0.27 () {58 vars in 1238 bytes} [Mon Jun 27 21:29:41 2022] DELETE /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 27 21:29:41.371817 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:41.372435 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:41.374384 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_api:SELECT=41 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:41.380398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:41.380948 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:41.382374 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:41.382807 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:41.386825 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG dbcounter [-] [117893] Writing DB stats nova_cell1:SELECT=77 {{(pid=117893) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 27 21:29:41.520703 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.policy [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117893) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:41.528648 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-18305f73-074c-4077-8d95-bb7720122e49 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1502 microversion: 2.1 time: 0.160928 Jun 27 21:29:41.529152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 603/1211] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:41 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 27 21:29:42.551365 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:42.552664 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:42.559946 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:42.560393 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:42.561155 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:42.561585 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:42.695308 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:42.703119 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-87a13353-c0d4-45ac-b765-d5ee07307f98 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1502 microversion: 2.1 time: 0.158793 Jun 27 21:29:42.703709 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 609/1212] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:42 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1502 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:43.400772 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [req-a97fd4e5-8cb9-4e72-8c7c-ded1843eb5af req-0c76b17b-a9a7-4664-bcf5-efae4959b99a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "03f48887-9ad5-4e36-a83f-aa9a5b021116", "name": "network-vif-deleted", "tag": "ef7880bc-8949-4698-b75d-349384fb58fc"}]} {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 27 21:29:43.410220 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a97fd4e5-8cb9-4e72-8c7c-ded1843eb5af req-0c76b17b-a9a7-4664-bcf5-efae4959b99a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:43.410655 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [req-a97fd4e5-8cb9-4e72-8c7c-ded1843eb5af req-0c76b17b-a9a7-4664-bcf5-efae4959b99a service nova] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:43.421891 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.compute.server_external_events [req-a97fd4e5-8cb9-4e72-8c7c-ded1843eb5af req-0c76b17b-a9a7-4664-bcf5-efae4959b99a service nova] Creating event network-vif-deleted:ef7880bc-8949-4698-b75d-349384fb58fc for instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 on hv-cinder-84773 Jun 27 21:29:43.426958 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [req-a97fd4e5-8cb9-4e72-8c7c-ded1843eb5af req-0c76b17b-a9a7-4664-bcf5-efae4959b99a service nova] 10.222.0.27 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030140 Jun 27 21:29:43.427644 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 604/1213] 10.222.0.27 () {64 vars in 1317 bytes} [Mon Jun 27 21:29:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 27 21:29:43.727799 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.api.openstack.wsgi [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117892) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:43.728820 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.compute.api [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117892) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:43.737158 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:43.737593 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:43.738346 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:43.738757 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:43.775712 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:43.776152 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG oslo_concurrency.lockutils [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117892) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:43.776598 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.objects.instance [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lazy-loading 'fault' on Instance uuid 03f48887-9ad5-4e36-a83f-aa9a5b021116 {{(pid=117892) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 27 21:29:43.825843 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: DEBUG nova.policy [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '836fc578997845b898bdc310ff93ca37', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef69c081a67644c7aecdcc06fc8e8675', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117892) authorize /opt/stack/nova/nova/policy.py:199}} Jun 27 21:29:43.834298 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO nova.api.openstack.requestlog [None req-cabb11a5-9d8a-41ad-a16a-b9bb6f088645 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 200 len: 1303 microversion: 2.1 time: 0.113632 Jun 27 21:29:43.834876 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: [pid: 117892|app: 0|req: 610/1214] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:43 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 27 21:29:44.857281 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Calling method '>' {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 27 21:29:44.858467 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.compute.api [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] [instance: 03f48887-9ad5-4e36-a83f-aa9a5b021116] Fetching instance by UUID {{(pid=117893) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 27 21:29:44.867790 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:44.868229 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:44.868987 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 27 21:29:44.869410 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG oslo_concurrency.lockutils [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Lock "c0f07735-a13a-4bd4-a3de-46acb69e68ee" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117893) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 27 21:29:44.883313 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.wsgi [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] HTTP exception thrown: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Request method failure captured: Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: request: GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 HTTP/1.1 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept: application/json Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Accept-Encoding: identity Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Connection: close Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Length: 0 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Content-Type: application/json Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Host: 10.222.0.27 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Openstack-System-Scope: None Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: User-Agent: python-urllib3/1.26.9 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Auth-Token: gAAAAABiuiEkX2UQyb-AbBfZLSwZ6uLO3SIoyL-kn87D4Ul9R3DhG9tg_lW05rURN8ms-OijwNNJ9TFD19lyOI1axkStthhhXr9YUOkAZyLgsE_bppo4DW3V4y3EWW_t--N0EuovhmXDWVYCWThzxa1kjJMHjDb2O7oSmzmBn7FJAlqi_Kvngu4 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Id: None Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Domain-Name: None Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Identity-Status: Confirmed Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Is-Admin-Project: True Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Id: default Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Domain-Name: Default Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Id: ef69c081a67644c7aecdcc06fc8e8675 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Project-Name: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Role: reader,member Jun 27 21:29:44.884986 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Roles: reader,member Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/image"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.27:8080", "publicURL": "http://10.222.0.27:8080/v1/AUTH_ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/compute/v2/ef69c081a67644c7aecdcc06fc8e8675"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.27/volume/v3/ef69c081a67644c7aecdcc06fc8e8675"}]}] Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Id: ef69c081a67644c7aecdcc06fc8e8675 Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-Tenant-Name: tempest-VolumesActionsTest-1377338596 Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User: tempest-VolumesActionsTest-1377338596-project Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Id: default Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Domain-Name: Default Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Id: 836fc578997845b898bdc310ff93ca37 Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: X-User-Name: tempest-VolumesActionsTest-1377338596-project Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: method: > Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: exception: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. Jun 27 21:29:44.886723 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: action_args: {'id': '03f48887-9ad5-4e36-a83f-aa9a5b021116'} Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: {{(pid=117893) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 27 21:29:44.887734 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. Jun 27 21:29:44.889582 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: ERROR nova.api.openstack.wsgi Jun 27 21:29:44.891152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: DEBUG nova.api.openstack.wsgi [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] Returning 404 to user: Instance 03f48887-9ad5-4e36-a83f-aa9a5b021116 could not be found. {{(pid=117893) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 27 21:29:44.891152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO nova.api.openstack.requestlog [None req-eb89812a-1e5a-4a07-a8e4-9cd105865993 tempest-VolumesActionsTest-1377338596 tempest-VolumesActionsTest-1377338596-project] 10.222.0.27 "GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116" status: 404 len: 111 microversion: 2.1 time: 0.036948 Jun 27 21:29:44.891152 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: [pid: 117893|app: 0|req: 605/1215] 10.222.0.27 () {58 vars in 1235 bytes} [Mon Jun 27 21:29:44 2022] GET /compute/v2.1/servers/03f48887-9ad5-4e36-a83f-aa9a5b021116 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 27 21:31:05.684770 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:05.686092 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:31:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:07.252526 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:07.253449 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:31:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:31:44.274630 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:31:44.275756 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:31:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:32:45.611795 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:32:45.612755 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Mon Jun 27 21:32:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:32:58.042399 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:32:58.043402 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Mon Jun 27 21:32:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:34:25.697855 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:34:25.698862 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:34:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:34:27.265029 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:34:27.265969 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:34:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:34:33.296940 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:34:33.297462 dv-cinder-847733-1-iscsi devstack@n-api.service[117892]: Mon Jun 27 21:34:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 27 21:35:04.286398 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 27 21:35:04.286933 dv-cinder-847733-1-iscsi devstack@n-api.service[117893]: Mon Jun 27 21:35:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!